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ABSTRACT 

* • Research findings concerning a class of rational 
strategies that emphasize linking schools with outside knowledge and 
expertise are summarized, with special attention given to findings 
from Jive recent or soon-to-be-completed studies. This report 
consolidates, organizes, and interprets the guan£itative research 
evidence concerning the roles, activities, job contexts, and effects 
of. external jinking agents and agencies on school improvement 
outcomes, and examines the role of the external linking agent in 
terms of a larger set of internal and external factors that affect 
these outcomes. Five issues are addressed specifically: 41) recent 
research findings implications concerning linking agent^f (2) linking 
agent roles in actual practice; (3) evidence concerning the effects 
and outcbmes of linking agents' efforts; (4) implications of recent 
studies 'for the selection, training, and support of linking agents; 
and (5) study implications for the initiation, continuation, or 
modification of efforts employing linking ageLjts to improve United 
States schools in the 1980* s*. An eight-page reference list, a 
four-page bibliography, and an additional publication list for DESSI 
(A Study of Dissemination Efforts Supporting School Improvement) 
publications are included. ( Author /LMM) 
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ABSTRACT 



This report summarizes some of the scholarly and empirical 
research findings of the past two decides concerning a class of rational 
strategies th,at emphasize linking. schools with outside knowledge and 
expertise.-' Speciarattention is given to an intensive examination and 
osynthesis of findings from five recent or soon-to-be completed studies. 
The purpose of the report is to consolidate, organize, -and interpret -the 
quantitative research evidence concerning the roles, activities, job 
contexts, and effects of external linking agents and agencies on school 
improvemenf outcomes, and to examine the role of the external linking 
agent in terms of a larger set of internal 'and external factors that 
affect these outcomes. Five questions are addressed, in this synthesis: '* 

1. What do recent research findings tell us about linking ageqts? 

2. What do linking agent roles look like in actual practice? 

3. What is the evidence concerning the effects and outcomes of the 
efforts of linking agents? 4. What are the implications of recent 
studies for the selection, training, and support *of linking agents, , 
and what are the effective conditions for the employment of linking 
agents? 5. What implications do these studies have for the initiation, 
continuation; or modification of efforts employing 1 i nklng* agents to 
improve schools in che United States in the 1980s? 
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PREFACE * 



This synthesis report is addressed to a small and specialized group 
of policy analysts, researchers and evaluators, program and project 
directors, dissemination specialists, and others who may fye concerned 
with the design, management,, or evaluation of programs and projects 
employing linking agents to assist local, school personnel in school 
improvement efforts* In this volume we have attempted to pull together 
in one place a selected body of recent research describi nj .1 inking agents 

^nd*the effects they have on schools. . 

* ** 

During the past five years, the Educational Oissemi nation Studies 
Program has sponsored the preparation of a series of eleven reports 
dealing with linking agents* This synthesis updates these earlier studies, 
summarizes two recent reviews provided by Michael Fullan (1981) and 
Karen Seashore Louis (1981), and then focuses on an intensive examination 
of five recently cbmpleted or soon-to-be completed studies.. Each of the 
selected studies deals with many aspects of programmatic school improve- 
ment; however, this synthesis will focus primarily on describing the work 
of linking agents and how linking agents affect and are affected by the 
^clients and others they work with in school improvement efforts. Initially, 
* the purpose of this study was much narrower, namejy, to compare the 
results of factor analyses of linking agent roles and activities that 
have been reported as part of the data analyses in four of the studies, 
and to interpret and relate these factor analysis findings to earlier 
theoretical and empirical descriptions of linking agent roles. However, 
as we reviewed the studies, we became increasingly impressed with the 
wealth of information they provided, not only regarding linking agent 
activities, but also regarding highly positive outcomes and benefits for 
school improvement as a result of their work. Consequently, we redefined 
the purpose of the synthesis as an effort to consolidate, organize, and 
interpret primarily the quantitative research evidence concerning the 
roles, activities, job contexts, and effects of agents and agencies 
working to link external knowledge to school improvement projects. 

The quantitative nature-of this synthesis should be noted. We warn 
the reader that this report does not attempt to deal with the very rich 
store of qualitative data and case studies included in the five studies. 
Moreover, the quantitative methods and results we chose to highlight and 
critique in the synthesis were, in some of the studies, simply used as a 
convenient means to organize qualitative data or to support primarily 
qualitative findings. In fact, in some instances, the methodology was 
primarily qualitative. .Rather, we have focused primarily on examining, 
comparing, and critiquing the quantitative findings. 

We also note, in fairness to the study researchers, that all the 
studies represent pioneering research efforts that deliberately attempted 
to provide much new in format ion on linking agents and school improvement. 
In most case^ appropriate instruments and measures did not exist and* 
there was often a dearth of prior research on which to base the study 
research designs. Moreover, the five studies are roughly contemporaneous, 
and were thus not able^ to draw fully_gn_ the„ findings of each other. 
This* synthesis Cfiu^~pFesents an organized body of findings that is vastly^. 
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larger than was available to the individual investigators at -the time 
they .initiated their research. Hence, our critique of specific instruments 
and approaches ts not* intended, and should not be read, as a criticism 
of tlfe way these studies were^esigned and executtfElV but rather as an - 
effort to strengthen the quantitative methodology that may be, employed 
in future. studies. 

Because the literature reviewed in this synthesis encompasses * 
several thousand pages of printed reports, we doubt that many readers 
will have th N e time or re,source.s to examine more than part of it. Fo^ 
this reason, we have provided much specific detail, especially with 
respect to statistical results, in order to save the reader who may be 
interested ir> th^ktatistical results some of the- time and effort required 
to obtain and consult the original reports. Moreover, we have made 
extensive use of footnotes to provide additional information* This 
choice has made parts of this synthesis, especially Chapters 1,11 and IV, , 
long and, in places,, quite tedious to read. We encourage the less 
technically oriented reader to skip over the statistical detail and the 
footnotes. This will make the reading a little easier, but not much. 
This is, 'admittedly, a difficult, fact-packed study that is not intended 
for casual reading. However, we sincerely hope that those readers with 
a serious interest in recent research on the role of linking agents in 
school improvement will find the effort required to read this synthesis 
worthwhile. . 

Special recognition is due Ward Mason and John Egermeier t at the 
National Institute for Education for their continuing assistances the 
planning, preparation, and review of this synthesis. The following 
persons have contributed by reading and commenting on earlier drafts: 
Naida Bagenstos, Pat Cox, John Egermeier, WiHiam Firestone, Karen Louis, 
Doren Madey, Matthew Miles, and Ward Mason. Where possible, we have 
tried to respond to their many helpful suggestions. Their assistance 
has helped to improve accuracy of the findings and interpretations which - 
are reported. However, their assistance should not be interpreted as an - 
endorsement. The conclusions and interpretations made in this synthesis 
are the sole responsibility of the author. Fred Rosenau* deserves our 
special thanks for editing this report. We also want to express special 
appreciation to Charles Altizer and Doris Smith for their assistance in 
typing the/ several drafts of this report and preparing final copy for 
reproduction. 
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EXECUTIVE SUMMARY 



This report summarizes some of the scholarly and empirical research 
findings of the past two decades and gives special attention to several 
recent studies of a class of "ration*! " strategies that emphasize linking 
schools with outside knowledge and expertise* Although the linking 
agent in these studies is^ometimes a single .person, neither the original 
scholarly conceptualizations nor the more recent program arrangements 
are so restricted* The linking "agent" may be a person or persons, or 
an agency or agencies, acting as intermediaries or "boundary spanners" 
between educational organizations and more di stant* sources of knowledge 
and assistance* In this synthesis we focus on linking agents who provide 
direct services to local elementary and secondary schools* 

Until recently, most of our research information about linking 
agents was concerned with external agents, i.e., with those persons and 
agencies located outside the larger client organization*' Recent studies 
have begun to define the role of internal agents, e.g*, schobl district 
central office staff, and to describe the relations and effects of both 
types of agents on the achievement of school improvement outcomes. These 
recent studies provide a wealth of information, including much impressive 
documentation of positive benefits for school improvement. Moreover, 
these recent studies tend to reinforce each other in many of their 
conclusions and offer strong evidence that linking agent strategies can 
i ndeed "improve schools. In order to make these results and their 
interpretations more generally available this syflthesis was undertaken. 
The purpose is to consolidate, organize, and interpret quantitative 
research f evidence concerning the roles* activities, job contexts, and 
effects of extferngj agents on school improvement outcomes, and to examine 
the role of the external agent in terms of a larger set of internal and 
external- factors that affect these outcomes. 



Five generic questions are addressed in this synthesis: 

1, What dp r&cent research findings tell us about linking 
agents? 

2. What do liking agent roles look 1-ike in actual practice? 

__3. WhatJ.s the. evidence^ concerning the effects and outcomes 

of the efforts of Jinking agents? 
«* 

4. What are the implications of recent studies for selection, 
training and support of linking agents, and what are the 
'favorable conditions for effective employment of linking * 
agents? 

5* What implications do these studies have for the initiation, 
continuation, or modification of efforts employing linking 
agents to improve schools in the United States in the 1980s? 
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Chapter I provides an introduction and overview of the synthesis. 

> 

Chapter II reviews studies that provide the theoretical and research 
foundations for the studies described in Chapter III. Theoretical concept- 
ualizations provided by Havelock, Piele, Crandall, and Butler and Paisley 
are reviewed and compared. The recent reviews of empirical studies of 
external linking agents (Louis, 1981) and of school district and school ~ 
personnel in knowledge util ization (Ful lan, 1981) are summarized. 

^Chapter III presents a synopsis of each of five selected studies. 
These include: 

• t Building Capacity for Educational Practice: An Evaluation of 
NIE's State Dissemination Grants Program; 

t. Study of Dissemination Efforts Supporting School Improvement 
I (a Study of v Four Major Federal Programs); 

' ,t Linking R&D with Schools: The Study of the NIE Research and 
Development Utilization Program; 

t The Research for Better Schools Local School Improvement Study; 
and 

t The Research for Better Schools Study of Regional Educational 
Service Agencies. 

Each study synopsis is organized into the following topics: 
1) a brief description of the dissemination pragram(s) included in the 
study; 2) a review of the explicit or implicit assumptions on which the' 
program(s) were bashed; 3) a description of the study methodology; 4) a 
description of the % key overall program findings; and 5) a .description of 
findings regarding linking agents. 

Chapter IV provides a cross-study synthesis. Five topics are 
examined in depths 00 * 

h r . 

r description and analysis of the gross* differences in linking 

agent rojes, across projects; *■ * * « 

t r^yiew of .findings' concerning' the* selection, training, and 

support o'f individuals performing linking 'agent*ro>es; 

** * ° 

t analyses of linking agent work, with special emphasis given to* 
a comparison of findings regarding coles, and activities per- 
formed by individual agents; * ' ». 

t comparison and analysis of the stucty findings regarding the 
'effects and outcomes of linking agent 'activities, and the 
relation of these effects „to other factors influencing school 
s improvement outcomes and benefits; and 

t description and ana-lysis of the effect of program, host organi- 
zation, and SGhQof-site staff on the activities of individual 



The findings for each topic are summarized below. 

Differences in linking agent roles across projects. Although 
the programs described in the 'studies involved several thousand linking 
agents, detailed data" is based on samples of agents totaling 428 persons; 
136 associated with the State Dissemination Grants Program (SDGP); 138 
associated with the regional educational service agencies included in 
the RBS study (RBS/ESA); 95 associated with the Dissemination Efforts 
Supporting School Improvement (DESSI) study; 53 associated with the 
Research and' Development Utilization (RDU) study; anjd six with the RBS 
Local School Improvement (RBS/LSI) study. Analysis of the descriptions 
of agent work suggested that three modal forms of assistance, or dominant 
linking agent strategies, are represented in the sample of studies, each 
representing approximately a third of the sample of agents: (1) biblio- 
graphic and curricular information utilization (SDGP), (2) legal and 
programmatic knowledge utilization, including consulting, training, and 
technical assistance (RBS/ESAs), and (3) rational problem-solving focused 
on the adoption and implementation of validated products and programs 
(DESSI, RDU, RBS/LSI); In terms of the scope and intensity of atfent 
work, the programs could be arranged in the order listed above. Typically 
SDGP agents served many individuals. Although there were exceptions, 
the agent's task was primarily confined to determining client needs for 
information, forwarding re^ifests for information searches to specialists, 
and then sometimes making deliveries and helping clients (usually 
individuals) to screen, select, interpret, or perhaps even use the infor- 
mation for some specific purpose. Next up the scale of intensity and 
down the scale of scope are the RBS/ESA agents. These agents exhibited 
very large differences depending on the predominant roles they played 
(curriculum expert/trainer, liaison, monitor) and the particular clients 
they worked with, but their work was often more, intense and special i*ed 
that that performed by SDGP agents, but yet not as intense and specialized 
as that of the DESSI, RDU, and RBS/LSI agents. Agents assorted with 
the last three projects all tended to work'jwfth a relatively 'Small number t 
of school sites, oftenworked with a local planning/implementation team 
rather than individuals, and focused on assisting school's to, define 
major educational needs , .search for appropriate, effective programs and 
products, and then assisted school^ in implementing these innovations. (V 

When the 1 inki ng. agents were ol ass iff erf by the dominant school 
improvement strategy they employed (Information Use Assistance; General • 
Technical Assistance; Problem-Solving/Program Implementation) and by the 
size of the agents 1 service region (Local; Intermediate/Regional; State/ 
Multi-State/National) a strong, correspondence was found. Most of the" 
information bse assistance agents (69%). are found at the local level; 
while most of the problem-solving/program implementation agents (72%) 
operate at state, multi-state, or national levels. It is suggested . 
that as 1 agents decrease Jhe number of clients they serve in order to 
increase the intensity and breadth of sevices they provide to clients, 
the more likely it is* that the agents will be operating in programs' that 
that are state, multi-state, or national in their service orientation. 
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, Viewed in another way, the data suggest that the knowledge and skills 
required to accomplish the more complex, specialized, and costly types of 
school improvement assistance may be in relatively short supply and are 
found only in the organizations of major federal and state dissemination 
programs, whereas simpler and less costly services may* be provided by 
many education specialists located in intermediate agencies and local 
school districts throughout the country* If this distribution of agents 
in the combined sample even roughly approximates the total population of 
education linking agents, the sobering implication is that the^'New 
Federalism" of the Reagan Administration may bring with it the demise of 
most of the more complex and ambitious strategies for school improvement 
that have been predominantly supported by federal funds, thus leaving, 
schools with only less costly and intensive forms of external assistance. 

Selection, training, and support fojvlinking agents. Only one 
of the five studied reviewed- provided extensive information on this 
topic, the Unking R&D with Schools (RDU) stuc(y, and particularly Spencer 
and Louis (1980). However, this source provides an extensive description 
for RDU agents, including a substantial statistical analysis of relation- 
ships between training and support measures and measures of linker atti- 
tudes and their expectations and perceptions of their behavior. In 
addition, these* relationships are examined in terms of three Intervening 
variables (age, percent time devoted to linking role, years teaching • 
experience). A relatively limited number of significant relationships 
were found. The RDU researchers concluded that the types of training 
and support systems that were 'employed by the RDU projects were not 
sufficently robust or intrusive to counter'the basic personality and 
work styles of the agents. It appears from the RDU findings that the 
predispositions and convictions of individual agents, as well as their 
previous job experience, may have much greater influence on Linker atti- 
tudes and behavior ttfan do training and support systems. However, the 
results do indicate that the support systems were more significafit in 
shaping attitudes and behavior than were the formal training events 
sponsored by the projects. Further, in another RDU report, Louis and 
Kell (1981, p. 171) conclude that the RDU data on agents do not support 
a "science of selection." The only characteristics that emerged as 
significant were agents' age, teaching experience, and dispositions to 
be supportive and low-profile rjther than "innovative." Teachers and 
principals were both more satisfied with agents disposed to the former 
style. Older agents and agents with more teaching experience were ipore 
likely to play content specialist roles that reduce conflict and job~ 
stress, but were less likely to perform central boundary-spanning activi- 
ties and generalist-coordinator roles that were more often associated 
with positive school outcomes. Although significant, the influence of 
these characteristics is not large. It appears that many different types 
of persons can perform effectively in these RDU field agent positions. 

Linking agent work. All five of the selected studies provide 
significant data on linking agent work. One remarkable methodological 
similarity among the studies is the fact that four of the five employed 
factor analyses of linking agent activity items to derive empirical 
descriptions of linking agent roles. The factor analysis results and 
related data are examined, compared, and critiqued in this section of 
Chapter IV. Twenty factors were identified in the four studies. 
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To make sense out of the list of 20 factors, an interpretation 
is^presented that suggests there are perhaps six highly generic clusters 
represented in the results of these studies: (1) a cluster represented 
by roles and activities which are concerned with general communication, 
liaison, coordination, and boundary-spanning; (2) a resource finding 
cluster; (3) a knowlege use facilitator cluster representing skills < 
especially employed to assist individuals in a broad variety of informa- 
tion use contexts; (4) a more specific curriculum expert/trainer, skil Is 
cluster; (5) a problem-solving/program implementation assistance cluster; 
^nd (6) a miscellaneous cluster lhat includes a broad array of administra- 
tive, financial, maintenance, housekeeping, self-development, and other 
functions that have been largely ignored in the analysis of linking agent 
work because they are less directly associated with agent-client interaction. 
Missing from the list is a pure process helper cluster. The reasons for 
its absence are discussed. The findings are reconciled with the Havelock, 
Piele, Butler-Paisley theoretical conceptions presented in Chapter II. 

Linking agent effects and outcomes. Four of the five studies 
provide data on this topic. These findings are examined .in substantial 
detail. The RBS/LSI, RDU, and DESSI studies are all remarkable contri- 
butions to the empirical literature on at least three counts. First, 
they provide significant information regarding intermediate or more distal 
outcomes and benefits in schools as a result of linking agent-initiated 
efforts to assist school staff to implement improved school practices. 
Second, all three studies provide data that indicate^how external assist- 
ance, local assistance (from central office administrators and school 
principals), and school staff characteristics/ activities interact to 
account for outcomes. Third, all three studies relied heavily on,a 
combination of quantitative and qualitative data to present, explain, 
and illuminate their findings. This wealth of data presents an immensely 
^detailed and complex set of images of the interplay of forces that are 
at work in major school improvement efforts. In order to organize 
these cross-study findings, data bearing on five themes are examined: 

The first theme is that impacts vary, depending on what you look at. 
Where a broad view was taken of possible outcomes, many significant 
positive effects and benefits were found. Thus, the lesson to be learned 
from these studies is that where major change efforts are involved, they 
ought to be matched by an effort to measure broad impacts that cover a 
variety of types of possible outcomes. 

A second theme is that external assistance can be important, 
but the size, nature, and even the positive or negative direction of 
influence depend on many factors (such as where, when, how, by whom, and 
for whom) is external assistance provided. The RDU and DESSI studies 
demonstrate that when multiple measures of linking agent assistance are 
combined with multiple measures of outcomes, complex hut meaningful 
patterns of impact are obtained. Both of these studies indicate that 
external assistance has substantially greater effects on some school 
improvement outcomes than on others, that different types of effects and 
benefits ar'e produced at the individual classroom teacher level and at 
the school organizational level, and that two types of assistance 
(generalist-facil>itator and specialist-trainer) combine to produce 
incrementally positive effects for several outcomes. 
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A third theme is that the nature of the innovation and, more 
particularly, the demands it places on local staff to undertake major 

.changes are important. In the RDU study, product characteristics alone 
accounted for substantial portions of variance on some outcome measures. 

-The DESSI study found markedly different models of predictor to outcome 
measure relationships for individual teacher outcomes when the sample 
was split into teachers fqr whom the innovation rejipesented-i major or 
minor change. When this was done, significant but different patterns of 
predictors were found in both samples. The number of "significant pre- 
dictors and the number of outcomes affected were both substantially larger 
when a major practice change was involved. Although the RDU data on 
product characteristics were aggregated to site rather 'than .individual 
^ teacher, there is a remarkable correspondence between the RDU product 
characteristics of complexity and difficulty of implementation, which 
positively„affected outcomes, and the DESSI distinction of minor versus . 
major practice change. Both studiesstrongly support the adage, "little 
ventured, little gained." Where much was ventured in attempting to . 
accomplish major practice changes, many different external and local 
assistance forces .came into play in accompl ishi'ng .individual and 
organizational changes that produced a wide variety of benefits. 

The fourth and fifth themes center on the .local assistance forces. 
The fourth theme is that local help from central office staff or school 
principals i's important. Local assistance was found to be a significant 
positive influence in all three studies— *DESSI, RBS/LSI, and RDU. The 
fifth and final theme is that the local context, including school and 
staff characteristics, readiness, ard motivation, is extremely important 
in accounting for outcomes. 

» 

In the aggregate, these studies provide impressive evidence that * 
externally initiated and facilitated change efforts can produce positive 
changes in scKools.^both in the curriculum and instructional practices 
of individual teachers and. in the organizational relationships and 
problem-solving structures and processes of schools as organizations. 
These changes, in turn, lead to many organizational and personal benefits 
for sthools, for staff, and for students. Moreover, although total 
change costs, including in-kind contributions of site and school district 
staff time and effort, were modest, large, brbad-scale change was often 
accomplished and these larger efforts were usually associated with large' 
payoffs. If little was ventured, little was. gained. A related point is 
that large amounts of external support (whether in dollars or assistance 
effort) were not always required and could sometimes even be counter- 
productive. What seemed to matter is when, where, and how external 
assistance is provided and toward what aspects of a complex sequence of 
change events it is directed. These studies show that external facilitator 
general ists often make their most potent contributions in getting things 
started properly and attending to organizational factors that mobilize 
and sustain local staff interest, committment, help, and participation. 
These agents also play other potentially important roles in finding and 
introducing appropriate high-quality products and practices, encouraging 
broad staff participation, and in helping to identify and arrange for 
intensive and extensive expert assistance and training at appropriate 
times.' These latter forms of expert assistance were often the most con- 
sistently positive, pervasive, "arid potent sources of'external assistance. 
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However, the effects of external assistance on outcomes were 
often matched by sources of internal assistance, beginning first with 
teachers themselves, and often extending to potent, if sometimes subtle, 
roles played by school principals. The role of central office staff can 
also be extremely important, but seems contingent on program design and 
other factors. * 

Perhaps the key point to alb these finding^ is that external 
assistance can help schools to improve in very powerful ways by initiating* 
and helping to. orchestrate a wide variety of internal and external per- 
sonnel * material, and knowledge resources so they can be focused, organized, 
and applied in systematic and sustained efforts to address significant # 
problems. Typically schools and school staff are organized to pursue 
relatively individual and isolated job rqles where attention perforce 
must be*given primarily to "maintenance" and ""coping" with routine 
daily activities. Consequently, it may well be that the mobilization 
and continued support of school staff to work, as individuals and as 
teams, on school improvement efforts that go far beyond- those they are 
able to addres^s individually in the normal context of their daily work, 
are the fundamental keys to the success of the. linking agents employing 
the Probl em-Sol vi ng/Program Implementation Strategies exemplified in the 
b programs that were examined by the DESSI, RBS/LSI, and RDU studies. 

Effects of programs, host: organization, and clients on linking 
agent activity. The final section or Chapter IV examines data indicating 
how contexts affect linking agents. Perhaps the key finding here is 
derived from the RDU study which indicates that what agents actually do 
is primarily a function of the. patterns of interpersonal influence in 
which they are embedded (Loui$;and Kell, 1981). Two influences appear % 
most critical: the support" and influence systems set up by the program 
and the sponsoring organizations, and the influence of and interactions 
with key school administrators who act as gate keepers in defining* what 
the agents will be permitted to do 4 in their di stricts, and schools. 
However, the RDU data especially indicate that agent strategies and 
approaches to change were primarily the products of their own-backgrounds 
and trailing. In most cases,, they learned to play'their linking agent 
role through tr*ial and error processes. Formal training provided by the 
' sponsoring organizations appeared to have little impact on their role 
performance, but repeated contacts with significant other (e.g., project 
and host agency supervisors and school administrators) tended to shape 
the orientation of their roles. 



The final chapter of- this report considers the prospects for 
educational linking agents and agencies in an era of funding cutbacks, 
program consolidation, and federal retrenchment. The first part of this 
chapter traces the growth of educational dissemination over the past 25 
years. These developments in the field of educational dissemination were 
played out in the context of much larger social , economic, and political 
events that influenced their development. Some of the major contextual 
changes are identified as are some of the more recent trends that have 
either positive or negative implications for educational dissemination 
in general or for linking agents in particular. Three trends appear to 
have negative implications for linking agents in the next several years. 
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First, there are likely to be markedly fewer categorical or programmatic 
dissemination and school improvement projects, primarily due to cuts in 
federal funds and to shortfalls in state and local funds. Second, there 
may continue to be a slow, but cumulative, erosion of institutional and 
organizational capacity to produce, disseminate, and tise new knowledge 
to improve schools except in limited, high-priority areas. This capacity 
will be reduced due to significant federal, state, and local reductions 
ia resources, including money, staff, time, energy, and organizational 
and professional incentives. Third, there will continue to be .marked 
shifts in educational agency priorities toward emphasis on provision of 
core services and maintenance of the traditional, long-established, and 
institutionalized agency functions. 

Given these trends, external assistance to schools, whether based 
on information use assistance, general technical assi stance,* or more 
comprehensive problem-solving/program implementation strategies, is most 
likely to obtain support and be successful only if it addresses#sonfe 
combination of three essential ingredients: it faces and competently 
helps solve critical educational problems, it is low-cost or cost-saving, 
and it is low-risk (politically, organizationally, and professionally). 
Hence, these trends and likely conditions also have positive implications. 
Theneeds for school improvement in the sense just described are pervasive. 
Assistance that addresses these needs successfully will be supported, 
not as experiments, or demonstrations, or special categorical projects, 
but as highly valued, if not esseritial, support services needed to reform, 
renew, and maintain effective educational operations in a post-industrial, 
high-technology society. In such a society, school improvement may 
eventually no longer be viewed as a collection of individual, interesting 
"ideas" and "innovations" to be episodically and singly adopted; imple- 
mented, and then incorporated or discarded, but rather as an intrinsic 
and continual aspect of the adjustment and renewal functions of a dynamic, 
adaptive schooling institution. We believe that the primative patterns 
pointing to the emergence of such an outcome are to be found in <the 
successful school improvement findings reviewed in this final chapter. 

In looking back over these trends and implications, we conclude 
that support for linking agents and agencies is substantially less certain 
than it was in the 1970s. However, we also conclude that the effectiveness 
of external assistance provided by linking agents, particularly those 
providing problem-sol>ving/program implementation assistance has been 
proven. Educational agencies, at state, intermediate, and local levels 
will need to decide whether and how they might work together to build 
and maintain external assistance networks. If these networks can face 
and respond effectively to the critical needs of schools in the 1980s,- 
there will continue to be an important role for linking agents to serve 
in school improvement efforts. 
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I. INTRODUCTION AND OVERVIEW 



Many types of persons and agencies are concerned with the maintenance 
and improvement of educational practices, and many types of approaches are 
employed to provide direction, guidance, or assistance to schools so as to 
enable them to maintain high educational standards while adapting to changing 
ediftStional 'and social conditions. This report summarizes some of the 
scholarly ancl research findings of the past two decades and gives special 
attention to several recent ^studies of a class of "rational" strategies that 
emphasize linking schools with outside sources of knowledge and expertise. 

Although the various linking agent programs and projects that were 
studied differed in many details, they tended to emphasize some, and some- 
times all, of the following characteristics: 

1. They empharized highly interpersonal forms, of communication 
to link school personnel with external sources of knowledge 
and expertise; * V 

2. They emphasized bringing to the attentior\j>f educators new 
educational practices, especially those resulting from 
systematic research and development or practitioner-developed 

* and validated demonstrations. Then they assisted educators in 

selecting and implementing new practices, appropriate to 
specific local needs; v * ^ 

3. They provided educators with technical assistance in identi- - 
fying needs, defining problems, searching for and selecting* 5 
appropriate solutions., and in planning' for, implementing, 

and evaluating selected solutions; 

4. As part of this process, they provided educators with new 
competencies, not only for using the new practices, but also for 
impp-oving the problem-solv.i ng practices of their schools; and 

5. They provided, feedback from educators to information resource 
specialists, trainers, R&D staff, agency and project adminis- 
trators, and policy makers. 

The performance oT these several roles provide the operational defin- 
ition of lipking agentry. Although those roles are sometimes viewed as 
played by a single person in a complementary fashion, neither the original 
scholarly conceptual izations nor the more v recent program configurations 
are so restricted. The linking "agent" may be a person or persons, or an 
agency or agencies, acting as intermediaries or "boundary-spanners" between 
operating sdhools and more distant sources of knowledge and assistance. • 
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Two more distinctions should be made. First, we should note that > 
linking agents represent a subset of a larger class of "change agents," 
who have the common feature of attempting to stimulate, influence, promote, 
induce, guide, vfaci litate^, or coerce change in schools* The hallmark of 
linking agentry is emphasis on the use of rational strategies and external 
knowledge sources to foster improved knowledge utilization among organizations 
and individuals. Second', we jiote that distinctions are sometimes made 
between external and internal agents, with external agents defined as 
those persons or organizations performing linking agent roles located 
outside the laYger client organization (usually a local school district) 
and internal agents defined as those persons- or suborganizations performing 
linking agent roles inside the'larger client organization. Until recently, 
most gf our empirical information about 1 i nki ng agents was concerned with 
external agents. Recent studies have begun to define not only the role 
of internal agents, but the relations and effects of both types of agents 
on the achievement of school improvement outcomes. 

These recent studies provide a wealth of information, including much 
impressive documentation of positive benefits for school improvement. 
Moreover, these recent studies tend to reinforce each other in many of 
their major conclusions and offer strong evidence that linking agent 
strategies can indeed improve schools. In order to make these results and 
their interpretations more generally available, this synthesis was undertaken. 
The purpose is to consolidate, organize, and interpret empirical evidence 
concerning the roles, activities, and effects of agents and agencies working 
to lirtk external knowledge to school improvement projects. 

Over the past five years, the Educational Dissemination Studies Program 
has sponsored the preparation of a series of reports dealing with linking 
agents (Blackwell, Hood & Pool, 1978; Butler & Paisley, 1978; Gates, 1978; 
Emrick & Peterson, 1978; Hood & Cates, 1978; Pool & Hood, 1978-; Paisley, 
BHackwell, Emrick, Rittenhouse & Cooper, 1978; Cates & Ward, 1979; Hood & 
Blackwell, 1980; Fullan, 1981; Louis, 1981). The reviews by Emrick and 
Peterson (1978), Fullan (1981), and Louis (1981), in particular, were based 
on reviews of emptrical studies. This synthesis updates these 1 * earl ier re- 
views, summarizes the recent reviews provided by Fullan (1981) and by Louis 
(1981), and then focuses on an intensive examination of five recently com- 
pleted or soon-to-be-completed studies of major programs involving linking 
agencies and agents: 

• Building Capacity for Educational Practice: An Evaluation of 
NIE's State dissemination Grants Program; 

• Study of Dissemination Efforts Supporting School Improvement 
(a Study of Four Major Federal Programs); 

• Linking R&D with SchooT^-The Study of the NIE Research and 
x x Development Utilization Program; 

^ The Research for Better Schools Local School Improvement Stucty; 
and 

• The Research for Better Schools Study of Regional Edjcational 
Service Agencies. 
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luch of those studios clouls with many aspocts of programmatic school im- 
provement, however, this synthesis jof these studies will focus on the role 
of linking agents. The generic questions to be considered are: 

a 1. What do these recent research findings t$ll us about link- 
ing agents? 

2. What do these linking agent roles look like in actual prac- 
tice? 

3. What Is the evidence concerning the effects and outcomes of 
the efforts of linking agents? 

4. What are the implications of recent ,studi es for training 
and support of linking agents, and what are the favorable* 
conditions for the effective employment of linking agents? 

5. What implication do these studies, have for the initiation, 
continuation, or modification of efforts employing linking 
agents to improve schools in the United States in the TjoUs? 

Chapter II reviews theoVetical'and empirical studies. Discussed in 
the first part of that chapter are several conceptual contributions and 
analyses, including those provided by Havelock, Pie.le, Crandall, and Butler 
and Paisley. Because these conceptualizations sometimes powerfully 
influenced the design of operational- linking systems, the specification 
of job- roles, and the study of linking agent activities and outcomes, they 
provide the reader with an overview of the conceptual frameworks that 
have been employed in examining linking agent functions. However, until 
recently, most of these conceptualizations of linking agents have been 
prescriptive and logical rather than descriptive and empirical. To 
provide readers with an overview of empirical findings, the second section 
of Chapter II summarizes the recent reviews by Karen Louis (1981) and 
Michael Fullan (1981). Louis reviewed the research literature on the role 
of external agents and Fullan reviewed the role of school district and 
school building personnel in knowledge utilization. The purpose of both 
these reviews was to explore ways in which external and internal linking 
agents affect local school improvement and knowledge utilization.. Both 
reviewers not only synthesize what is known on the basis of empirical- 
research, but also point out gaps and deficiencies in current under- 
standing of these roles. Chapter II thus provides theoretical and empirical 
foundations for the examination of the studies described in Chapter III. 

Chapter III presents a synopsis of each' of the five selected studies. 
To facilitate comparison, each synopsis is organized i nto the following 
' topics: 



a brief description of the dissemination program(s) included 
in the study; 

review of the explicit or implicit assumptions on which the 
program(s) were based; 



9 

ERIC 



1.3 



2,. 



• description of the key overall program findings; and % * 

• description of key findings regarding individual linking 
agents. 

Chapter IV provides a cross-study syndesis. Five topi ts are examined 

• description and. analysis of the gross differences in link- 
ing agent roles across projects; 

• review of findings concerning the selection, training and • 
^support of individuals performing linking agent roles; * 

• analysis of linking agent work, with special emphasis given to 
a comparison of findings , regarding roles and activities per- 
formed by individual agents; 

• comparison and analysis of the study findings regarding the 
effects and outcomes of linking agents, and the relation of ^. 
these effects to other factors influencing school improve- 
ment outcomes and benefits; and 

• description and analysis of the effect of program, host 
organization, and school-site staff on the activities of 

* individual agents. ' 

The final chapter of this report considers the prospects for education 
al linking agents in an era of funding cutbacks, program consolidation, and 
federal retrenchment in education. 
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II. REVIEW OF PREVIOUS ^THEORETICAL AND EMPIRICAL STUDIES. 



A. Theoretical Conception s of Linking Agent Roles * 



1. ; Introduction 

< 

The general literature on change and innovation has been reviewed 
by Rogers and Shoemaker (1971). * More recently, Glaser and others (1976) 
have provided a comprehensive distillation. In the field of education, 
Havelock (1969) produced a definitive synthesis, which has been augmented 
by several specialized reviews and a.nalyses (e.g., Eidel] and Kitchel , 
1968, in educational administration; Short, 1973, in curriculum; Gross, ( 
Giacquinta, and Bernstein, 1971, in implementation of organizational ( 
innovations; Zaltman, Florio, and Sikorski, 1977, in planning and manage-' 
ment of educational change efforts; Emrick and Peterson, ■ 1978, on five 
major studies of federally sponsored educational dissemination and change; 
Nash and Culbertson, 1977, on current conceptions of the- linking processes 
in educational improvement, and Lehming and Kane, 1981, on knowledge use 
in schools). This diffusion/change literature offers ample evidence that 
new ideas and practices are spread most efficiently and used, with greatest 
effect when their dissemination and util i'zatipti is facilitated by a person, 
or a team of persons, functioning as a linking agent -who conveys knowledge 
from more distant sources to ultimate users and assists users in applying 
that knowledge .in their work. However, as we have noted elsewhere (Hood 
and CateSv 1978), anyone who facilitates the transfer of educational -kaow- 
ledge could be considered a linking agent, but such a simplification leads 
to a rather unacceptable conceptual situation since virtually anyone in 
the field of education may be involved in the transfer of knowledge to 
someone else. Typically the concepts of "linkage" and "linking $gent" 
have been much more restricted. 

Lippitt (1965) appears to be the first author to have suggested the 
term "linking ag£nt"; however, various related concepts such as "social ^ 
engineer" (Watson, 1945) appear in earlier literature. Glaser and Wrenn 
(1-966) envisioned a change aid team that might go to any city or insti- 
tution to help in implementing systems changes. Lazarsfeld and others 
(1967) addressed the need for collaboration between sociologists and 
clients, and envisioned a new profession of persons who would be able to 
understand the social scientists and yet be well acquainted with practical 
client problems. Use of a consultant in this middle-person role was pro- 
posed by Lippitt and Havelock (1968) and Havelock (1968). The functions 
of this middle-person or linker role were elaborated by Havelock (1969) 
in the following typology of knowledge linking roles and functions: 



*This section is based in part on Hood and Cates (1978). 



Role 



Functions 



'Conveyor - transfers knowledge from producers (scientists, experts, 
scholars, developers, researchers, and manufacturers) to 
users* 

Consultant - assists users in identification of problems and resources, 
provides linkage to appropriate resources, assists in ad- 
aptation, series as a process facilitator. 

Trainer - installs in the user an' understanding of an entire area of 
knowledge "or practice. 

Leader - effects linkage through power or influence in one's own 

group. 

Innovator - (includes originator and also the first user in a social 
" system to adopt an innovation) initiates diffusion in the 
user system. 

Defender - sensitizes users to the pitfalls of innovations, mobilizes 
public opinion, public sensitivity, and public demand for 
f adequate applications. 



Besides, these generic roles, Havelock identified individuals associated 
with knowledge production, di ssemination* and utilization subsystems who 
play different linkage roles. 

Although much of the literature focuses on individual roles or teams 
of persons,. Havelock and others have identified linking agencies and linking 
systems. Perhaps the most frequently cited example of a complex linking 
system has been the publicized achievements of the U.S. Department of Agri- 
culture's Cooperative Extension Service (CES). The CES provides information 
and information-based services to agricultural clients on the complete spec- 
trum of on-the-farm needs. The cornerstone of this system is knowledge, 
much of it based on sound research and development or on experimental farm- 
tested and proven practices. But this knowledge is augmented by a variety 
of print and othor media designed for spocific agricultural users, preser- 
vice and inservice education of agricultural personnel, stato demonstration 
projects, and technical assistance services. Extension specialists provide 
the human linkage with various specialized disciplinary ot; problem-oriented 
knowledge bases, and county agents provide linkage with local agricultural 
clients. * Thus the CES offers a complex example of (a) 1 i nki ng.agents, (b) 
linking agencies, and (c) an integrated Jinking system. ^CES examples have 
strongly influenced the conceptualization of educational linkage. 

; v. • 

2. Recfent Concepts in Education: the Piele 'Analysis 

Piele (1975) attempted a broad review and analysis of the role,, activi- 
ties, and training of educational linking agents, based on accessible litera- 
ture published in the previous five- years. Piele noted that writers have 
p^pposed various models ~of7the~ change process and in some cases have tried f 
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to show that the particular linking agent role in their models would lead 
to more effective dissemination and utilization. "But few descriptive 
and comparative studies appear to have been conducted to determine which 
of these roles is most effective, and fewer still have reached meaningful 
conclusions" (p. ii). ^ * 

In this analysis Piele examined several di ffererit models and their 
implications for linking agent roles. He noted that innovation-specific 
models (e.g., R&D, Innovation Diffusion) are geared toward diffusion*. and 
adoption of specific innovations and assume' that most problem-solving 
work has been done before adoption takes place and that many problems of 
adaptation/maintenance have already been anticipated arid solved. By con-, 
trast, the Problem-Sol vi ng Models (and their variants, e.g. , Intervention ' 
Strategies, 'Planned- Change, Action Research) tend to be oriented primarily 
to the process of innovation adoption or problem solution within the client 
system. Piele concludes ttfat different loci of problem-solving expertise 
imply further that there will be fundamentally different modes of inter- 
action between agent and client,' ranging primarily from directiv e (adop- 
tion of a specific innovation) to collaborative (adaptation and cl.ierit. de- 
velopment of innovation process skills) to ~nondirective (problem- solving 
per se). 

• * From these distinctions Piele infers three principal types of linking 
>agent roles and, borrowing from Havelock's role /terminology, labels these: 
resource linker, process helper, and solution gfver. Piele notes that dif- 
ferences among these roles are too substantive to be simply results of em- 
phasizing different aspects of the change process. Rather, they describe 
several different change processes that cover a<whole range from adoption 
of R&D products (solution giver) through adaptation of externally developed 
knowledge skills and innovations (resgurce linker) to user-initiated problei 
solving (process hqlper). . -After brief 'descriptions of each role, Piele com 
pares their advantages ai>d disadvantages (pp. 28-30)~: 

The resource linker* role is characterized by a low level 
4 of interpersonal interaction, a high level* of client, in- 
itiative and responsibility, a t low level of involvement 
with each intervention, and a high level of distribution \ 
throughout the system * . . Training for. this role can 
be relatively brief, straightforward, and apparently H ~ 
inexpensive . . . 

TJhe role of process helper demands a > h igh level of inter- 
personal interaction, some client initiative and compe- 
tence in adapting the innovation, and an intermediate 
level of agent training ... * 

An effective solution giver is highly interpersonal, with 
fow client initiative and a correspondingly high agent 
responsibility for overseeing the adoption and Jnstitu-, * 
tionalization of the innovation. Training for'such agents 
will be expensive and only partially transferable . . * 

In short, the nondirective agent role is obviously limited, 
the collabprative process general ist wiW have difficulty 
helping with the installation, of complex and sophisticated 
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innovations, and the directive solution giver is expensive 
and difficult to train. In general, the* more extensive , 
the agent's coverage, the less intensive his or her in- 
volvement, and the more costly and time consuming is the 
preparation. 

Figure 1 summarizes Piele/s comparisons. But it also suggests what 
may be perhaps the most practical organizing notion we have yet encountered 
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COMPARISON OF THKEE LINKING AGENT ROLES 
ACCORDING TO AGENT AND CLIENT CHARACTERISTICS 



characteristics'^--^ 


Resource 
Linker 


Process 
Helper 


Solution ' 
Giver 


Extent of Agent Skills/ 
Training Required 


Low 


Medium 

*> 


High 


Interpersonal 
Interaction 


Low 


i 

Medium " 


High 


Agent Involvement with 
Intervention 


Low 


Medium 


High 


Agent 'Distribution 
Throughout System 


High 


Medium 


Low 


Client Initiative 


High 


Medium 


Low 



* Modified from Plele (1975; p. 30). 



for sorting out different linking agent roles and fuctions; namely; how much 
time and effort can be spent pef client? The resource linker role costs 
little in terms of agent skvlls and training and is low, in cost per client: 
These economies are achieved by avoiding substantial involvement with indi- 
vidual clients and/or individual interventions. v For success to be achieved, 
this role must be matched to high initiative and high client capability to 
use delivered resources. Qbviously the closer the delivered resources match 
user readiness, understanding, and capability, the motre probable the success 
of this role. By contrast, the solution-giver role is high jh post Mn terns 
of time (hence cost) required per client. These skill requirements and per- 
client time costs result from the high degree of interpersonal ^interact ion 
and high degree of agent involvement in specific innovations. In effect, 
this role attempts to compensate for what may be low qliejit initiative 
or capability. - 




If many clients must be served by a few agents, and especially if 
these agents are relatively unskilled, then the resource linker -role may 
of necessity be the one played most frequently, simply because it is 
the least expensive. Process helping can be successful only if (a) the 
agent possesses the required skills and (b) the agent has enough time to 
spend with some, perhaps far from all. clients. The solution giver role 
is feasible only when agent skills are extensive £nd ample time can be 
spent with individual clients. Hence the practically employable ^oles ^ 
depend greatly on the breadth (and appropriateness) of the agent s rep- 
ertoire of skills, but perhaps more directly on the number and accessi- 
bility of clients the agent is required to serve: Broadly skilled agents 
maty perform all three roles, but may need to reserve their solution giver 
role for a select portion of their clientele. 

Piele's review of the literature and resulting discussions identified 
a number of problems (Nash and Culbertson, 1977, foreword, p. viii): 

1. Functions -of linking agents do r\$t typically delate to im- 
portant system variables that influence change and improve- 
ment in schools. % -\ 

2 Little research exists on linking agent functions. < 

3. Little attention is paid to the nature and quality of infor- 
mation to be conveyed to practitioners. 

4. Linking tends to be equated with change and with -adoption of 
innovations rather than with support for program improvement . 
efforts. . / ■ 

5. The school administrator's role in the linking process is 
often ignored. ' - 

6. Functions of information provision, technical assistance pro- 
vision, and helping the school system build its capability 
to** assess and improve education are usually seen as separate 
and integrated roles. 

3. The "Linking Process in Educational Improvement" Volume 

Subsequently, the National Institute of Education (NIE) commissioned 
a group of concept papers that addressed several of the issues mentioned 
above. These were published by the University Council for Educational 
Administration (UCEA) as Linking Processes in Educational Improvement , 
1977. This volume addressed three objectives: 

1. To provide for educational leaders an up-to-date, synthesis 
on the role of linking agents and agencies in educational 
improvement activities and to identify and discuss important 
knowledge utilization issues of interest *to the research, 
development, and training communities; 



2. To address the Immediate realities that internal and'exterrial 
linkers confront and to shed light on the kinds of organiza- 
tional, human, and knowledge resources available to them; 

3. To provide better bases for advancing linkage through new 
plans and developments. 

Although special attention was focused on improving the training of 
linkers, the overall goal was to present concepts that "will advance new 
developments and plans and will stimulate new inquiry into linking agents, 
linking agencies, and their functions ... in order to illuminate the 
complex processes of linking and their role in facilitating change. '■• In 
addressing these objectives, each author focused^on a different aspect of 
the linking process and different aspects of the problems identified by 
Piele. \ 

Douglas Paul (1977) considered change in the context* of educational 
organizations and discussed Havelock's four models of change that can . 
influence apd/or be used by linking agents. Jaek Culbertson (1977a) 
presented the broad perspective of the larger environment of knowledge 
resources and uses that are pertinent to change and postulated five uses 
of knowledge that can support those engaged in change or providing 
support for change. j 

James Lipham (1977) examined the role of the administrator in 
implementing educational improvement and the leadership functions required 
in that role. Ann Lieberman (1977) discussed linking agencies and the 
functions these agencies perform in the context of the school as a social 
system. 

* * 
Issues directly related to the external linking agent were addressed 
by David Crandal 1 (1977). In examining the "universe of the linking agent," 
he described three major perspectives on the current practice of linking 
agentry, the resource system on which the agent can draw, the client 
system served by the agent, and the "host agency," whefe external linkers 
reside. In addition, he considered the multiple roles and functions 
-performed by linking agents, attributes and skills associated with the 
roles, and tbe issue of selection versus training. 

Crandall distinguished between the front-end (predecision) and back-end 
(postdecision) phases of the innovation adoption process and identified 
five linking agent roles and functions associated with each. The roles and 
functions associated with t front -end activities are: 

, Role Functi ons 



Product peddler - promote sale or adoption of particular product. 

Information linker - clarify information needs; search for and pro- 
vide dat$ and information. 

Program facilitator - provide client with variety of curricular and 

instructional approaches. 



Process enabler 
Provacateur/doer 



assist client with client problem identification 
and development of appropriate action. *~ 

devise- and initiate alternative futures for edu- 
cation. 



Five complementary back-end roles are associated with the postdecision 
phase of impl.ementation/institutipnal ization in the innovation process. The 



are: 



Role 



Functions 



Resource arranger 
Information 1 inker 
Technical assister 



Action researcher/ 
data feedbacker 

Educator/Capacity 
buil der 



- assure availability of and access to resources, 

- clarjfy information and resource needs. 

- get kinks out of a particular program; assist 
with general problem-solving. 

- help schools learn how current experience can 
be applied to future problems. 

- help establish capacity to cope with future 
problems. 



In conclusion, Culbertson (1977b) depicted a future scenario of a 
nationwide training system for linkers; he also described pertinent 
support functions, concepts, and events that shape the scenario itself* 



4. The Butler and Paisley Analysis 

In an effort to build upon the concepts presented in. the UCEA volume, 
the Far West Laboratory commissioned Butler and Paisley (1978) to examine 
relationships among linking functions and the linking agent role in the 
context of factors that determine the functions that affect the role. 
They described the historical context in which educational dissemination 
has evolved and examined three major clusters of dissemination concepts 
identified .and analyzed since 1966: diffusion of new ideas and practices, 
structure and function of dissemination programs, and multiple contexts in 
which dissemination occurs. 

They noted that an analysis of past and present experience in dissemi- 
nation programs employing linking agents indicates that roles and functions 
of linking agents are differentiated along two dimensions. One involves 
the internal versus external organizational locus of linkage activity. The 
other involves the linking agent's "entitlement" to act on behalf of. the 
organization in different ways. The concept of "entitlement" accounts for 
marked differences in the approach of linking agents to clients and the 
nature of the ensuing exchange. 
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External and internal linking agents have in common a "boundary span- 
ning" function. Both bring into an organization, or into a unit within an 
organization, knowledge and skills that the unit needs but lacks relative 
to <i problem or task. External linking agents have typically represented 
themselves to clients as available external resources whose lack of specific 
knowledge of the client organization could be compensated for by the agent's 
commitment of time and resources to the client's problems. By contrast, 5 the 
internal agent is likely to be knowledgeable about the organization, but may 
be less likely to "move heaven and earth" on behalf of clients. Butler and 
Paisley note that an organization's capacity for self-directed change is 
symbolized by its staff of internal linking agents, "whether their titles 
emphasize planning, problem solving, fact finding, or other functions." In 
many cases, large school districts already have staffs of Specialists for 
self-directed change, so there is little that ,an "all-purpose" external 
linking agent can Qffer a large school district. Butler and Paisley also 
prophetically note that the ratio of external to internal linkage may de- 
cline over time as more school districts gain capability to perform linking 
functions internal ly. 

Because the concept of entitlement is somewhat novel, we. quote at length 
from Butler and Paisley: 

♦ The second dimension that differentiates the roles and func- 
tions of linking agents involves the linking agent's "en- 
titlement" to act on behalf of the client organization in 
different ways. Three modal linking roles result from 
three "entitlements" as follows: 

1. Resource Finder . At the lowest level of entitlement, 
a linking agent serves as intermediary between the 
client organization and knowledge resources* The 
linking agent may conduct information searches or 
make interpersonal contacts to find answers to clients' 
questions. The linking agent "negotiates" clients' 
questions to make them answerable, but does not under- 
take an analysis of the client organization to determine 
if the right questions are being asked. Information 

is turned over to clients in the form of bibliographies, 
documents, briefing memos, etc. .Only infrequently is 
the resource finder called upon to make presentations 
to clients, and the structuring of information into a 
set of recommendations usually goes beyond the entitle- 
ment of this role. 

2. Process Helper . Given some degree of entitlement to be- 
come involved with the actual problems of the client 
organization, the linking agent becomes a process helper. 
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^Assisting schools to acquire and institutionalise knowledge use and problem 
solving skills were explicit objectives of some of the projepts to be reviewed 
in Chapter III. 
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The process in question may be technical (facilitating 
problem and analysis and decision making), interpersonal 
(facilitating group interaction and managing conflict), • 
or both. The process helper may be a proponent of a 
particular approach to problem analysis, group dynamics, 
etc., but is N neutral with respect to the substantive 
problem or decision. 

3. Solution Giver . Given entitlement to represent one solu- 
tion or set of solutions to the client organization's 
problems, the linking agent becomes a solution giver. 
The auspices under which the solution giver works with 
a client organization are more important than the au- 
spices of resource finding or process helping. The solu- 
tion giver is often affiliated with an R&D organization 
or other product developer whose reputation becomes 
part of the solution giver's entitlement* Soma linking 
agents in this role act as brokers for extensive sets 
of solutions, such as those catalogued in Educational 
. Programs That Work . 

The general terms in which these three roles are described 
derive from Piele (1975)* The concept of "enti tlement" is 
our own effort to account for marked differences in the 
approach of linking agents to clients ,and the nature of 
the ensuing exchange. At a simple level of analysis, the 
linking agent and client form a communication dyad. Each 
brings to the exchange a frame of reference (cognitive 
structure), a set of assumptions concerning the. purposes 
of the exchange, an agenda of goals, and expectations' con- 
cerning the role that the other will play. Expectations 
concerning the other's role are one aspect of 11 entitlement," 
as is the concept of "legitimation" from the sociology" of 
roles. 

However, entitlement to play a particular linking role is 
more than an ascription from the client of the moment. 
Entitlement travels from one client to another with the 
linking agent, and one of the initial tasks of the linking 
agent in contacting a new client is to clarify—and justify 
if necessary--the entitlement under which certain linking 
functions are to be performed* Linking functions themselves 
are only partly indicative of the particular role; there 
is functional overlap among the roles. The auspices of the 
linking agent's work are an even poorer indicator of the 
role, since employees of the same organization may act as 
resource finders, process helpers, and solution givers. 
(Butler and Paisley, 1978, pp. 30-31) 

To illustrate the overlap among roles, Butler and Paisley depicted (s'ee 
Figure 2) the three modal roles represented as apexes of the same triangle 
of linking functions. They noted that, theoretically, a linking agent may 
perform any combination of functions shown in the triangle, but because 
juxtaposed functions call for related skills, it is more likely that an 



Figure 2 
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agent will perform a set of functions in one region of the triangle only. 
At the bottom of Figure 2, they divide the triangle into four regions that 
correspond to the three modal roles, as well as to a "general ist/scout role 
that primarily involves communication functions alone. The possibility that 
a linker may seek to play all four rales creates the possibility of a fifth, 
"superl inker" role. 

The triangular depiction in Figure 2 introduces a new way of thinking 
about roles and their relations to functions. In this conceptualization, 
the linker roles, as described by Havelock and elaborated by Piele, are not- 
seen as functionally well-defined and mutually exclusive categories. Rather 
they -can be seen as less well-defined areas of functional specialization. 
Linking agents may perform any or all of the functions mapped. Also, 
further specialization, perhaps involving performance of one or two 
functions, is possible. Conversely, linking agents may perform functions, 
in more than one area of specialization. And, at least in theory, a 
"superl inker" could play all specialized roles. 



5. Comparison of Linking Agent Roles 

On first examination, the roles described by Crandall seem to be con- 
siderably removed from those described by Havelock, Piele, and Butler and 
Paisley. However, some reconciliation is possible. Crandall s distinc- 
tion of "front-end" (predecision to adopt or change) and "back-end" (P°st- 
decision) is an heuristic device. The two sets of roles are seen by CraTidal 1 
as mirror images of similar styles of linking agent behavior. Are these 
five roles telatable to the Butler and Paisley schema? (See Figure 3.) 
Crandall's product peddler, resource arranger, and information linker roles 
are all variants of "resource finder." His program facilitator/technical 
assister roles are somewhere in the "solution giver" area. His process 
enabler and action researcher/data feedbacker roles are obviously versions 
of the "process helper" modal role. However, the provocateur/doer and 
educateur/capacity builder roles are not easily placed because of their 
strong anti-status quo character, but' they seem closest to the superlinker 
in their role requirements. In Figure 3 we display a comparison of these 
several versions of linking agent roles. Descriptions from which these 
conceptions are drawn are more concerned with the agent's idealized style 
of operation or mode of contact with the client than with the actual func- 
tions and activities performed. Hence the term "modal roles used by 
Butler and Paisley (or "archetypical" roles used by Crandall) can be ap- 
plied to the roles and functions of Havelock and Crandall as well. 

Linker contexts . Unfortunately, in the theoretical literature we find 
that discussions of these roles and functions are rarely associated with 
a specific context in which they are performed. The discussions give little 
if any indication of the factors that influence or change the character, 
cost effectiveness, support needs, and other aspects of linking agent per- 
formance. They tell us little or nothing about characteristics of the 
client organization, goals of the dissemination agency, amount of time a 
field agent can spend with a client, etc. In essence, such descriptions 
and definitions are global in their nature. * 
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FIGURE 3 

COMPARISON OF LINKING AGENT ROLES 
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Similarly, discussions pointing to the influence of contexts on v.ari- 
' ous roles and functions also can be said to emphasize global and generic 
contexts rather than specific contextual factors that affect particular 
roles and functions or those system variables that i nfluence change and 
improvement in schools. For example, Butler, and Paisley remind us of the 
multiple contexts in which educational dissemination occurs: historical, 
political, economic, social, psychological, cultural , etc. They point out 
that such "contexts" are circumstances that differentiate settings in which 
educators work and in which dissemination takes place, and emphasize the 
far-reaching effects of context upon dissemination. In particular, tney 
state that "ultimately it is the context of a program that determines its 
structure and function, its scope and -duration, and its acceptance and 
utilization by clients." 

Crandall gave special attention to' the "universe of the linking agent" 
in terms of the three contexts in which the linker is most directly involved 
the resource system, the client system, and the linker s host agency, in 
describing thfr^urce system, he reviewed the types of resources available 
to the linking agent, the sources of products and programs for the linKing 
agents, and the attributes of innovations *s they are perceived by the po- 
tential user. He concluded with this emphasis (p. 204): 

... it should be obvious that a prime requirement for 
« linking agents is' not only greater understanding of the 

tangible resources which they will be called upon to bring 
to clients or themselves but also increased skills in com- 
prehending and coping with the motivations, operating as- ^ 
sumptions and preferred styles of interaction of those in 
the resource system. The linking agent's task as the _ inter- 
mediary playing a translation role relative to potential 
resources is vastly complicated by the multiple-innovation 
phenomenon. The factors noted above are but one part of 
the universe with which linking agents will interact, and 
these factors are in dynamic tension with the features of 
the client system itself... 

The focus of his discussion of the client system serves to illustrate 
the complexity of the school culture and to stress the need for 'inking 
agents to understand the many facets of the client systems with which they 
work. He stresses that knowledge of organizational dynamics is essential 
to effective management of planned change. 

Crandall also considered agencies or organizations in which external 
linking agents will be housed as one of the influences on effective dissem- 
ination efforts. Most host agencies think of their function more in terms 
of their relationship with clients than in terms of their relationships 
with and expectations for the linking agents themselves. Responsibi ility 
•for providing an adequate support system for linkers must fall to the host 
agency (p. 213): 

Linking agents?will invariably face ongoing problems of 
marginality (role-role distance) with both their clients 
and their colleagues. They may suffer from a sizable gap 
between their various professional roles and their concept 
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of self. It is the host agency's responsibility to build 
in support mechanisms which lead to increasing role* link- 
age, 'defined as a relatively small perceived gap between 
one's own role and that of others and of self. 

Although discussions such as Butler andPaisley's and Crandall's accu- 
rate ly point to critical contextual factors, they can point only to what 
ought to be considered. They do not provide the more specific information 
necessary for effective planning, training, and linking. 

Most analyses proceed directly from discussidn of roles to discussions 
of prerequisite personal attributes or requisite competencies (knowledge, 
skills, sensitivities) for those roles. 

In virtually every case, the derivations are primarily logical deduc- 
tions, though often based on general observations and sometimes on personal 
experience in the role. HoWever, virtually all the derivations are tech- 
nically incomplete and few, if any, are grounded in systematic observations 
of the job performance or in empirical task analyt's. 



6. Summary 

The concept of the linking agent is recent (Lippitt, 1965). Although 
action research, group dynamics, and planned change are ideas that have 
been discussed for several decades, the active interest in linkage (as a 
form of dissemination) between educational R&D and educational, practition- 
ers can be traced specifically to Havelock (1968-69). * The Pilot State Dis- 
semination Program (1970-1973) possibly represents the first intentional 
national effort to place full-time educational linking agents in the field 
(serving school personnel in Oregon, South Carolina, and Utah). Aside 
from a few isolated case studies, the Sieber et al. (1974) "Evaluation of 
the Pilot State Dissemination Program" represents perhaps the first sys- 
tematic empirical analysis of roles and positions (three project directors, 
12 information specialists, and seven field agents). Other empirical 
studies by Emrick et al. (1977) of the National Diffusion Network, by the 
Center for New Schools (Moore et al., 1977) of Technical Assistance Groups, 
and by Blackwell et al. (1978) of the Research and Development Utilization 
Program are all so recent that their .implications for linking, agentry are, 
still being examined (see Emrick and Peterson, 1978, for one recent Syn- 
thesis; see the next section of this chapter for recent reviews by Louis, 
1981, and Fullan, 1981). In the absence of substantial" accessible data, 
most conceptions of educational linking agents have been prescriptive 
and logical rather than' descriptive and empirical. Havelock's image of 
three modal roles (resource linker, process helper, and solution giver) 
has exerted a substantial influence on subsequent thinking, first through 
Piele's review and analysis and then more recently through the Butler and 
Paisley exposition of linking agent "entitlements" and their conception 
of areas of specialization. Crandall's conceptualization has pushed these 
synthetic idealizations slightly more toward reality by identifying and 
describing a variety of roles that he believes can be found among recent 
educational dissemination efforts. As demonstrated, Crandal Ts roles can 
be mapped onto the Butler and Paisley role speciality "triangle." Hence, . 
at an analytic level, there appears to be no contradiction. However, 
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nearly all our knowledge is based on idealized conceptual frameworks- 
>and derivations that are very tenuously grounded in observational data. 
Systematic inquiry into the real world and work' of various kinds of edu- 
cational linking, agents has barely begun and is acutely 'needed in order 
• to verify or correct the derivations of job and task descriptions, per- 
sonnel requirements, training object ives/etc. , which are now'based pri- 
marily on ungrounded theorizing and conjecture. It js toward this end 
that we contribute this synthesis of recent empirical literature. In 
the next section we summarize two recent reviews of empirical literature. 




b 



2.L5 



J 



1 

■ B. Empirical Conceptions of Linking Agent's Roles 

Karen Louis (1981) and Michael Fullan (1981) reviewed, respectively, 
thp roles of external agents and the roles of school district and 
building personnel (internal agents) in knowledge utilization. The pur- • 
pose of both these reviews was to explore the ways in which external or 
internal Unking agents affect local school improvement and knowledge e 
utilization. Both authors attempted not^only to synthesize what is known, 
but also io point out gaps and deficiencies in current understanding of 
these roles. 



1. External Agents and Knowledge Utilization 

Drawing on recent research (e.g., Sieber et al., 1972; Corwin, 1972; - 
German and McLaughlin, 1974, 1975, 1977; Runkel and .Bell, 1976; Emrick 
et al., 1977; Miles, Fullan, et al^ 1978; Moore et al. , 1977; Louis 
and Seiber, 1979; Louis, Rosenblum, et al., 1981), Louis specifically 
addressed the question of the impact of external agents on schools and 
individual educators. . However, before doing*so, Louis (1981) examined 
the various definitions and conceptions of external agents and th*en 
proposed her own broader definition: 

An external agent is an individual » gr.oup, or organization 
located outside the boundaries of the client system, whose 
objective is to assist c1ient(s) — individuals, groups, in- 
dividual educators, groups of educators, groups of schools-- 
to enhance the clients' functioning as educators or as an 
educational system, (p. 180) 

Louis carried a step further the Butler and Paisley conception of en- 
titlement as a dynamic interplay between agent and client. She called for 
the need to view agents' roles from a user (client) perspective rather than 
from an agency-focused or change model perspective. She noted that extern- 
al agents serve at the pleasure of the client system and must therefore ad- 
just their roles to system expectation.* Louis (pp. 182-184) cited several 
studies that illustrate the role negotiation process: 

the Pilot State Dissemination Program indicates that 
successful agents engaged in a relatively lengthy* period 
of role negotiation . . . (Louis and Sieber, 1979) 

... on the average, administrators in client schools have 
an equal or greater impact on the ways in which agents spend 
their time, and the activities in which they engage, than 
either their immediate supervisors or the directors of the 
projects in which they work. (Louis, Kell, et al., 1981) 



^Butler and Paisley make nearly the same point: "Different client organi- 
zations create a need for the linking agent to perform different sets of 
linking functions, thereby moving from the center of one role in the di- 
rection of other roles'* (Butler and Paisley, 1978, p. 32). 
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. . . mutual adaptation between the technical assistance 
group and the focal setting [is] ... a prominent char- 
acteristic of successful change strategies. This process 
often involves conscious attempts to, get feedback on strat- 
egies and roles, and to" alter them to f-it with the local 

school culture. (Moore et al., 1977) 

* r 

Louis skillfully organizes her review" of the empirical literature on 
external roJes % in education, and in other social fields, around two sets 
of variables that may influence the impact of the agent upon the client: 
status variables and external agent behaviors- and strategies . 

Status variables . Irrespective of tha specificity of an agent's role, 
Louis suggests that the following four status variables may have a signifi- 
cant impact on the agent's role performance: (1) homophyly,' (2) locus', (3) 
single versus team organization, and (4) personal agent characteristics. 
In.the following paragraphs we briefly summarize portions of the, review. 

Homophyly . In the field of education, Corwin (1972) found that 
the greater the dysfunction between Teacher Corps participants and the schools 
that they served, the lower was the level of program implementation. Sieber 
et al. (1972) reported that the Pilot State Project education extension agents 
tended, at least initially, to seek out clients in Positions similar to those 
the. agents had held themsel ves.' Moore et al. (1977) noted that successful 
technical assistance groups' often made their own value biases highly expl.icit 
so, that clients who did not agree with these biases could "opt out*."* 

Locus . * Locus of the linkage activity, or, more simply, whether the 
linking agents "are internal or external to their client organizations, was 
one of the two major dimensions on which Butler and Paisley differentiated 
linking agentry.* Louis noted that research evidence that attempts .to 
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Butler and Paisley, 1978, pp. 23-26, approach the issue of homophyly by con- 
sidering the multiple context's (cultural, historical, political, economic, 
social, psychological, organizational, work) that linker andclient may or 
may not share. They note: "The "effects of context on dissemination pro- 
grams are far reaching: Ultimately it i\s context that determines its struc- 
ture and function* its scope and duration, and its acceptance and utiliza- 
tion by clients . . . Even within a successful program—which, according 
to •our contention, is a program operating within favorable contexts--di s- 
parities between the specific contexts of program staff and some clients 
become limiting circumstances of program effectiveness." They further note 
that although "close- in" programs, like teacher centers, are perhaps most 
influenced by context, even relatively distant (from the client) programs 
like the Educational Resources Information Center (ERIC) are influenced, as 
can be seen in the demography of ERIC users, among whom researchers, .gradu- 
ate students, and education specialists of vari oijSp kinds are overrepresented. 

Sutler and Paisley (1975, 1978) J urther differentiated locus by level (na- 
tional, state, regional, or loca-1); by base (government-centralized, gov- 
ernment-decentralized, professional association, university, -private- for- 
profit, private-non-profit, consortium). 



compare directly the value of internal and external agents is relatively 
rare. Howfever, she suggested that may be the wrong question. Corwtn's 
(19,73) study of the Teacher Corps found that both the external agents and 
the presence of "young, flexible, supportive" boundary persons are impor- 
tant in organizational adaptation. Moreover, a recent analysis of schools 
in the R&D Utilization Program (Louis, Rosenblum, et ak, 1981) found that 
the involvement of external change agents, including linker 11 general ists" 
and trainers, was general ly more powerful in predicting school change than 
when these agents were not involved, but that both internal and external 
agents were important.* Louis made the cogent point that 

...the definition of external/internal depends entirely 
on where one stands. From the perspective of the federal 
government and most writers concerned with educational 
policy, any organization that exists below the state lev- 
vel represents a blurry category known as "local." From 
the perspective of a school-based educator, on the other 
han'd, a specialist situated in the district office may 
have no better understanding of the problem of a p<<rticu- 
. lar school than an expert called in from several hundred 
miles away. (pp. 188-189) 

Teams versus individuals .. The general literature often favors 
deployment of teams because they can provide a richer set of resources and 
change strategies and can also provide support to one another. However, 
Louis noted that her recent analyses of the R&D Utilization Program (un- 
published) suggest that teams consisting of more than two or three, people 
can seriously overload the client systems, since school-based practitioners 
tended to have difficulty understanding the roles that each of the outsiders 
was supposed to play. However, the R&D Utilization study also supports the 
notion that the most effective strategy is one that utilizes a division of 
labor between an individual playing a "facilitating/generalist" role and 
one or more individuals who provide more specialized training around the 
content area in which change is planned (Louis, Rosenblum et al., 1981). 
Many recent efforts, as noted previously, point to the complementary need 
for the creation and support of locally based "teams" (Corwin, 1973; Moore 
et al., 1977; Emerick, 1977; Miles, Fullan, and Taylor, 1978). 

Personal characteristics of agents . Just as in research in the 
area of leadership, one can find many lists of desirable attributes of 
agents, but there is really little solid empirical work that has stood the 
test of successful replication. 

Agent strategies . In addition to the status variables reviewed above, 
Louis cited evidence to suggest that the following five categories of extern - 
al agent behaviors and strategies may also be crucial determinants of agent 
role performance: (1) initiative in outreach to clients, (2) intensity of 



*As will be seen in Chapter III, the study of Dissemination Efforts Support- 
ing School Improvement (DESSI) also found that internal and external agents 
were important. 



2.19 



outreach activities, (3) agent expertise, (4) scope of activities, and 
(5) relationships with boundary personnel in client settings. In intro- 
' ducing this section, Louis reviewed the arguments of saveral authors who 
have argued for a "contingency" approach to understanding the relationship 
between change strategies and outcomes in different contexts. Louis con- 
cluded this discussion with the observation that, if one wishes to generate 
an effective contingency model, it is almost imperative to start at the 
strategy level (as defined by Hall et al., 1979).* The level of tactics 
is too discrete and "messy," while the game plan level is too abstract. 

Following her own advice, Louis suggested that the following dimen- 
sions may define the choice of agent strategy. 

I nitiative . Initiative refers to the amount of energy and effort 
that an external agent must exert in order to reach the client.- Both dis- 
semination programs and agents within programs may vary widely on the 
dimension of initiative. Louis asserted: "There is overwhelming evidence 
to suggest that, in most cases, high-initiative^ (face-to-face, redundant) 
tactics will be required to stimulate wide interest in a new service that 
may be offered by an external agent" (p. 195). It appears that the level 
of initiative required to stimulate clients is associated with the 
research versus craft dimension (stimulating clients to use research 
requires greater effort), to the dimension of time/familiarity with a 
service, and also to specific characteristics of clients that dispose 
them to be "early adopters" or "laggards." However, little or no research 
has been done on the amount of initiative required to involve educators 
or educational institutions in the utilization of externally generated 
knowledge. 

Intensity , Intensity refers to two dimensions of external agent 
involvement with a particular client: calendar time , i.e., the degree of 
long-term involvement with the client, and absolute time , i.e.-, the total 
cumulative time spent with a client. For example, Louis and Sieber (1979) 
found a positive correlation between total amount of time the agent spent 
with clients and the level of client use of information. Runkel and Bell 
(1976) found that in the case of organizational development (OD) training, 
a low level of intensity was worse than no training at all. Miles, Fullan 
et al. (1978), in a survey of 76 schools using OD, found that the intensity 



*Hall et al., 1979, pp. 10-12, developed an empirically based taxonorny of 
five intervention levels: policies, game plan, strategy, tactics, and 
incidents. Policies are the general rules or guidelines. Game plans are 
the overall design for the combination of intervention strategies that are 
taken to implement an innovation. Strategies represent the implicit or 
explicit assumptions about how people and organizations function or change 
that ,guide the choices of actions (tactics). Tactics are the aggregations 
of incident interventions that in combination have an effect that is dif- 
ferent from the effects of the individual incidents, which are singular 
occurrences of an event or action. Hall noted that, based on their empir- 
ical work, it is clear that strategies of change agents often emerge as 
poorly defined extrapolations of an accumulation of tactics, which may 
not necessarily be coherent or supportive of the intended change goals. 
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of external consultant involvement, measured in total days spent, and 
calendar time, measured in years, were positively related to OD program 
impacts and client attitudes toward OD; however, intense involvement by 
external consultants was negatively related to institutionalization of 
the OD process. Louis, Rosenblum, et al. (1981) found that several types 
of change agent intensity made independent contributions to R&D utiliza- 
tion school improvement outcomes, e.g., time spent with the principal, 
time spent attending meetings. Further complicating the relation of agent 
intensity to outcomes is the "readiness" of the client, and also the nature 
and the stage (early, late) of the information utilization process. For 
example, data from the Pilot State Project indicate that when the know- 
ledge utilization process is decision oriented , external assistance in 
later stages is critical. But the data from the R&D Utilization Program 
indicate that when the objective is capacity building , time spent by the 
agent in the early stages is critical, since during this period clients 
are most open to intensive discussion of processes, the nature and scope 
of their problems., alternative means of searching for solutions, etc. 
Research to date points to agent intensity as an important dimension 
that has complex and not-yet-well-mapped relationships wvth outcomes. 

Agent expertise . Louis noted that, although one would assume 
that agents should be experts or specialists , the evidence supporting the 
need for technical expertise is mixed. Many authors have distinguished 
between content and process expertise.* However, empirical data bearing 
on the issue are sparse and far from conclusive. Findings are further 1 
confounded by the question of individual versus .team delivery. Louis, 
Rosenblum, et al. (1978), for example, found that in R&D utilization 
projects that used both process ^eneralists and training by program de- 
velopers and other content specialists, there were differences in the 
degree to which each contributed to various outcomes. General ists were 
more important in encouraging school staff to view their problems more 
broadly and to choose innovations requiring a greater scope of change. , 
However, the overall amount and variety of sources of specialized train- 
ing played a more significant role in determining the degree to which 
changes actually appeared to affect pupils and also the degree to which 
teachers reported personal growth. Both general ist support and special- 
ized training contributed significantly to the continued use of new prac- 
tices in client schools. Emerick et al. (1977) noted that generalist 
facilitator assistance in early stages of awareness and adoption decision 
stages, with developer/demonstrator technical expertise and training pro- 
vided through the implementation stages, has teen, by design, institution- 
alized effectively in the National Diffusion Network program (NDN). Louis 
noted that, as a research agenda, the issue of expertise will require more 
careful definition of terms, e.g., making distinctions between expertise 
that is acquired by formal training and skill that may be learned inform- 
ally. 



*As we have noted in Figure 1, Piele found that levels of expertise may vary 
according to the roles assumed by the linking agent. Crandall (1977), Butler 
and Paisley (1978), and Hood and Gates (1978) have also noted the relation- 
ship between roles and levels and types of expertise. 



Scope/cost . Scope of agent services refers to the number of clients 
that the external agent can manage at any given time. Louis notes that 
no studies address the issues of costs and benefits, nor is much attention 
paid to the impacts of increasing or decreasing the scope of activities 
of individual agents. Hence most of what we know in this area is based 
on judgments about very general findings. Louis (1975) pointed out that 
in the Pil f ot State Dissemination project, scope and intensity were nega- 
tively related. Since high initiative and front-end activities were nec- 
essary to serving high numbers of clients, increasing scope was associated 
with less follow-up assistance to clients after the delivery of informa- 
tion. Data from the NDN study (Emrick et al . , 1977, p. 61, p. 122) in- 
dicate a negative relationship between high scope for NDN facilitators 
and outcome leasures, since high-volume awareness and outreach activities 
tend to ger rate .a large volume client response that makes follow-up ac- 
tivities wi ch each client erratic or nonexistent. However, these follow- 
up activities are critical to successful NDN project implementation,* 

Louis observed. that the question of "large scope" versus ^small scope" 
is relative to the program and its strategy. In the Pilot State project, 
a high-scope linking agent may have served 10 to 15 new clients per month, 
not including follow-up activities with previous clients. In the NDN a 
facilitator project might provide services to between three and 25 new 
adopters at the district level each year.** By contrast, in the R&D Util- 
ization pro.gram, the number of schools served by a full-time linking agent 



*In 1978, the Educational Dissemination Studies Program asked Emrick to 
reanalyze 1974-1976 NDN cost data by role, state facilitator (SF), or de- 
veloper/demonstrator (D/D), and activity for projects and for client unit 
costs. These data are too detailed to report here. However, Emerick's 
analysis indicated that in 1975-76, when NDN w?s still in relatively early 
stages of start-up, the costs, per NDN adoption , were approximately $68 
for awareness activities, $705 for training, $588 for implementation as- 
sistance, and $341 for other activities (e.g., materials development, 
staff training), for a total cost of services per adoption unit of $1802. 
Of course, not all NDN activities lead to adoptions. In 1974-75, total 
SF and D/D costs were approximately $4,046 per adoption. By 1975-76, 
these costs had dropped by more than $1,000 due to increased NDN effi- 
ciency (Paisley, Blackwell, Emerick, Rittenhouse and Cooper, 1978, pp. 
37-47). 

f 

r *The Emrick analysis cited in the previous footnote indicates that in 
1975-76 the average NDN D/D project, budgeted at $70,000, made 2,203 
awareness or demonstration contacts, conducted 90 training sessions, and 
provided implementation assistance to 61 schools or school districts 
(op. cit. > p. 42). 
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over a three-year period ranged from three to 12.* Finally, a typical suc- 
essful school district OD program may involve an external consultant for 
half- or full-time work over a period of several "years. Louis outlined a 
number of factors that should be considered in planning a research agenda 
to examine the issues of scope. 

Agencies as agents . Louis concluded her review with a discussion of 
the concepts of agencies as agents, citing Havelock, 1969; Corwin, 1972; 
Glaser, 1976; Moore et al., 1977; Lotto and Clark, 1978; Miles, 1980, and 
Yin and Gwaltney, 1981, and others for examples of discussions of inter- 
mediate units, colleges of education, nonprofit technical assistance 
groups, and other types of agencies that play various linking agent ro]es. 
Finally, Louis discussed the effect of agencies on agents. Sieber et al. 
(1972) had noted in the context of the Pilot State Project that agents 
enter into relationships with their clients carrying all the reputational 
baggage of the state and local organizations that sponsor them. Although 
in the early Pilot State Project it appeared that the sponsoring organiza- 
tions were insensitive to the need for communication with and support for 
dispersed staff members, thereby generating job stress and dependence on 
clients (Louis and Sieber, 1979), the more recent R&D utilization projects 
indicate that increasing communication and influence from supervisors also 
tends to result in higher levels of job stress (Louis, Kell et al., 1931). 
Louis noted that there is an inherent tension among the agencies' desire 
to influence the job performance of agents, the desire to increase client 
orientations, 'and the need to minimize role conflict and job stress. The 
analysis of the R&D. Utilization Program -at least .makes one feature regard- 
ing agent supervision and support clear: Agents are most likely to be in- 
fluenced by role partners who work with them and who are accessible for feed- 
back and interaction. Thus agents are far more likely to be influenced by 
the local organization in which their offices are housed than by more distant 
central offices or state department supervisors (Louis, Kell et al . , 1981). 

A research agenda . In her final section, Louis suggested a research 
agenda^ Fi rst she noted the serious lack of theoretical * frameworks in 
which the study of external agent roles might be located. She noted that 
one of the main deficiencies of research is the emphasis on a single func- 
tion of knowledge use (instrumental-decisionistic) and a single type of 



*The Paisley, Blackwell, Emrick, Rittenhouse, and Cooper (1978) cost an- 
alysis of educational extension services also provides highly detailed 
data on percentages of time and estimated hours per site spent by R&D 
utilization agents working in different projects (pp. 23-36). For ex- 
ample, data from five of the seven projects indicate that median number- 
of hours spent per site during the problem identification phase was 176 
hours with a range from 124 to 230 hours as the average time agents in 
each of the five projects spent. The largest single category of service 
was "i nforming 11 (70 hours), followed by planning assistance (39 hours) 
and initiation/ motivation (35 hours). During the solution selection 
stage the average hours per site was far more variable across the fiye 
projects, ranging from a low of eight hours for one project to a high 
of 280 for another project. The median was 48 hours. 
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knowledge (externally generated research information). This limited con- 
text of knowledge use research has tended to place equal 1 imitations on 
research about the role of external agents* Most inquiries have viewed 
the agent largely within the- "technological-push" framework, in which 
schools are seen as adopters^of better research products and in which 
topics are defined by federal agendas, rather than by school personnel 
as participants in the process of determining what types of knowledge ^ 
would be useful. Thus one of the derived research gaps is the general 
lack of research on what schools and educators want in the way of know- 
ledge and assistance. Also needed is more information on the costs and 
benefits of usi'ng externa^ versus internal agents and on the relation- 
ship between such individuals. 

In addition, Louis noted that summative questions about the relative 
impact of internal and external agents should be postponed until there is 
an improved understanding of the relationship between the two.* Informa- 
tion about agent skflls, skill mix, and the use of teams of agents is also 
extremely limited. The area of those personal characteristics of agents 
that are associated with "success" is probably the most murky of all the 
areas she reviewed. Louis advised that; this area should receive low prior- 
ity until a better understanding of the dimensions of agent activities can 
be established. In this regard, Louis noted that one of the most surpris- 
ing features of the existing research is the lack of detail about agent be- 
haviors. The main cause of this gap appears to be the emphasis on studies 
that involve multiple sites and cross-section designs, since such studies 
make it difficult to gain in-depth evidence in any detail about what agents 
actually do, particularly at the level of tactics and incidents. In re- 
viewing the priorities in terms of her list of strategies, Louis concluded 
that the information needs are most pressing in the areas of expertise and 
scope/cost, since in both cases the conceptualization of the research is- 
sues is underdeveloped, whereas the policy implications are very signifi- 
cant. But least critical in her view is the issue of initiative, with the 
possible exception of unique cases that pose difficult access problems. 
Finally, Louis called for more attention to be paid to the ways in which 
organizations act as external agents. <* 



2. School District and School Personnel in ..Knowledge Utilization 

Michael Fullan, in a companion chapter of Improving Schools , explored 
what is known about knowledge use within schools and school districts. Af- 
ter examining the difficulties in defining the concept of knowledge utili- 
zation (KU) and considering the causes of KU in schools, Fullan examined 
the roles of four groups: teachers, principals, district specialists/con- 
sultants, and district administrators. 



*As will be seen in Chapter III, Louis herself provided some information 
on this point in the analysis of RDU project data. The DESSI study also 
begins to address this issue. 
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Defining knowledge use * With tongue-in-cheek, Ful lan employed a "mul- 
t i s t r angu 1 at ion" ("It wi 11 t ake your breath away, if not render you uncon- 
scious") review of the range of meanings and levels that can be found in 
the literature on knowledge utilization (KU) in education. He started with 
the simple levels of knowledge use by individuals--non-users, readers, plan- 
ners, implementers--and then added five "complications," namely, (1) behav- 
ioral use of information may not be the most frequent or valuable outcome; 
(2) sometimes KU refers to specific use of specific projects or programs, 
whereas at other "times it refers to more diffuse uses; (.3) sometimes KU is 
concerned with individual users, while at other times it refers to use by a 
group of users, such as a school 0£ a school district; (4) there is confu- 
sion when different but overlapping aspects are characterized as a process 
(e.g., the Dissemination Analysis Group, 1977, definitions of four dissem- 
ination usages— spread, exchange, choice, and implementation; or the program 
implementation stages--mobil iza tion, implementation, institutionalization); 
and (5) not only do individuals or groups receive information for their own 
direct use, but most of them also pass the information on to others. 

Causes of KU . Fullan provided a general overview of the factors that 
affect knowledge use in schools by suggesting that KU is a function of 
three major sets of factors: the nature of information , the approach used, 
and the characteristics of the setting of use*. After reviewing research 
on the characteristics of information and impact on KU in education and 
in other social fields, Fullan concluded: "One gets a sense of general 
agreement that information which is relevant, clear, amenable to action 
images, and so on is most effective for KU" (p. 1'28). He then noted that 
the question of determining the best strategies or approaches to facili- 
tate KU is on enormous one. However, the main .findings are that KU (in 
the sense of particul ar uses of information, such as in the adoption of 
an innovative project J - is associated with approaches that provide direct 
personal forms of intervention and occur over a period of time , during 
which the user makes initial selection or adoption decisions and receives 
support (e.g. , training, resources, psychological support) on a continuous 
basis, from initial implementation to eventual incorporation. Conversely, 
if we are concerned with the notion of KU as a way to diffuse and expand 
the use of information, what is known is much more problematic and is 
perhaps best reviewed by Louis (see immediately preceding sections) 4 . 

Ful lan then briefly reviewed a number of characteristics of the set- 
ting that inhibit or support KU, including: leadership, organisational 
process (communication, cl imate) ,' i ndi vidual characteristics, and differ- 
ences in organizational structural characteristics (i.e., elementary vers- 
us secondary schools) and community characteristics (e.g., size, resources, 
teacher unionism). Fullan next reviewed the roles of teachers, principals, 
district specialists, and district administrators. 

* Te achers as knowledge users * Fullan considered three different KU 
roles of teachers: (1) teachers as direct individual knowledge users, (2) 
teachers as participants in planned change efforts, and (3) teachers as 
agents of KU. Fullan began his review by noting that, due to limited ac- 
cess to external sources of information, the isolated nature of their work, 
and heavy teaching loads, teachers are frequent users of neither research 
knowledge nor practitioner knowledge. However, much of the research on teach- 
ers as users seems to ignore the diffuse, longer-term impact of educational 



knowledge that teachers pick up through workshops, readings, casual dis- 
cussion, and so on. Surveys of teacher use of sources of information, 
(Hood and Blackwell, 1076) and of studies of teacher planning (Clark and 
Yinger, 1980) have suggested several points: (1) teachers rely heavily 
on personal sources; (2) the heavy emphasis teachers place on face-to-face 
discussions within schools may indicate that more KU exchanges occur than 
is commonly known;* and (3) the heavy emphasis teachers place on use of 
textbooks and curriculum materials points to another unknown area of KU. 
There is some evidence that textbook publishers and salespeople are major 
disseminators of curriculum knowledge. 

Teachers as participants in planned change . This literature tells 
us that. KU among teachers occurs when: 

• • . (a) the information is of a certain character (rel- 
evant to needs, specific in an application- implication 
sense, perceived to be valid/accurate); (b) the approach 
is person-intensive, interactive, and continuous in pro- 
viding technical* and psychological support; and (c) the 
setting (district, school) possesses characteristics of 
administrative support, peer interaction, and problem 
solving behavior* All three sets of factors must be 
present if any widespread KU is to occur—apparently, 
this is something which infrequently happens. (Fullan, 
1981, pp. 225-226) 

Teachers as agents of change . Fulfan has pithily summarized a brief 
review of research on teachers as supporters of KU as follows: "Teachers 
do not frequently interact on professional instructional matters, but when 
they do, it can be very powerful in affecting KU" (p. 226). After review- 
ing research based on adoptions of innovations in 13 high schools (Daft 
and Becker, 1978), a national survey of -innovations reported by superin- 
tendents (Havelock, and others, 1973), Barrows' (1980) study of adoption 
activities in 13 schools that adopted Individually Guided Education (IGE), 
and several other studies, Fullan offered these tentative observations 
regarding teachers as initiators of change: 

(1) Teachers as a category may be responsible for and/or 
play key roles in many instances of KU, t?ut this does 
not tell us anything about the average KU. instigation of 
teachers. Indeed, other evidence indicates that the av- 
erage teacher is not engaged in these efforts. Nor do 
we know much about the average KU of 'individual teachers 
(as distinct from the initiation of KU). • 

<. 

(2) When teachers do push for change, it is likely to in- 
volve curricular, classroom-related innovations. More 



*However, ethnographic descriptions of teachers in informal social situa- 
tions in schools suggest that many teachers deliberately avoid discus- 
sions that would result in the exchange of schoo J -oriented KU. Later 
in his review, fullan (p. 226) made essentially the same point. 

0 
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comprehensive schoolwide or district changes come from \ 
other sources. \ 

\ 

(3) The Daft and Becker (1978) and Havelock et al. (1973) \ 
research does not assess "utilization," but only initia- \ 
tion or adoption. Therefore, conclusions about firm KU 
are unwarranted. Moreover, little Js known about the 
process of mobi 1 1zation--those activities, events, and 
KU behavior which lead up to a decision to adopt an in- 
novation. 

(4) Teachers are important sources of support or lack of 
support for KU of other teachers, whether it be individual 
or group-based use. 

(5) In sum, research is needed on: (a) the role of teach- 
ers in the processes of mobilization and decision to adopt; 
(b) average KU behavior of teachers; (c) elementary and 
secondary school differences; and (d) the different proces- 
ses according to variations in rural, suburban, urban,' dis- 
trict size, and other contextual conditions. (Fullan, 1981, 
pp. 227-228) 

Principals as agents of KU . Fullan opened this topic by noting that 
after ZU years of meaningless generalities depicting the principal as the 
gatekeeper of change, there is finally some very sound and detailed re- 
search currently being conducted on the role of the principal vis-a-vis 
change. Fullan has demonstrated his point in an extensive review of 
large-scale surveys and focused research studies. From this review he 
concluded that, though on a per capita basis principals have much more 
opportunity for access to external sources of knowledge than do teachers, 
the majority of principals do not take advantage- of , or their work situation 
does not support them to use, these sources of information. However, 
the most effective principals (by reputation) do draw more extensively 
on external resources, and they cite curriculum or instruction as a 
higher priority than do less effective principals. Moreover, Blumberg 
and Greefield (1980) also pointed to the enormous amount of information 
processing internal to the school that effective principals carry out. 
In viewing principals as agents of KU , Fullan concluded: 

Research consistently found that a large percentage of 
principals*(at least one-half) were preoccupied with ad- 
ministrative work and organizational maintenance activ- 
ities^ Of the other principals, the exact role in KU 
was somewhat ambiguous and variable. There was some evi- 
dence that direct leadership in instruction was strongly 
related to KU (see Wellisch et al., 1978), but other evi- 
dence that it may be dysfunctional (Leithwood et al., 
1978). By contrast, facilitatiye Leadership by 'princi- 
pals was found to be effective (Leithwood et al., 1978). 

These are not necessarily incompatible findings. There 
are at least three aspects of the problem which need to be 
clarified. First, we need more operational definitions 
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of directive and facilitative modes. It is likely that* 
different components and meanings are currently being 
included. For example, directive can range from having 
a clear instructional image to authoritarian imposition 
of poorly thought out or centrally directed programs.^ 
Facilitative can range from a laissez-faire relation-" 
ship to teachers to one of active support. Second, it 
is possible (and there was some evidence to support this) 
that effective elementary school principals play a more 
direct instruct ional role, and secondary school principals 
carry out a. more indirect role. Third, returning to the 
multidimensional nature of KU, it may be that centrally 
derived programs are more effectively used by directive 
principals (when they agree with the program), and indi- 
vidualistic KU is better served by facilitative principals. 
Despite these variations, the research reviewed was clear 
that some form of active involvement and support by th.e 
principal was essential for KU by teachers. Furthermore, 
these principals had been effective at coping with (del- 
egating, repriorit izing) administrative frocesses that pre- 
occupied their colleagues. 

Finally, the research was in agreement that the principal, 
in a positive or negative way, is critical— in fact, may be 
the most critical *agent--for KU pf teachers. (Ful lan, 1981, 
p. 240) 

Pi strict special i sts/consultants . Ful lan introduced this topic by 
observing that internal agents are probably more critical for KU than are 
external consultants because of the necessity for continuous personal in- 
teraction.^ District staff are among the most likely persons to play this 
internal agent role, but there is not much specific research. The evi- 
dence we do have suggests that district consultants are _not particularly 
effective, but that they can be, depending on how they are organized and 
how they carry out their work. After reviewing nearly a score of studies 
Ful lan concluded this review as follows: 

In summary, we can draw four main conclusions about the 
role of district consultants: 

1) There is limited research and underestimation of the 
potential role of district resource staff. 

2) District staff are crucial for introducing new ideas 
• and facilitating ongoing interaction, dialogue, help, 

and support. 

3) While district support staff are crucial, they are 
infrequently effective because (a) as individuals 
they often carry out their work on a one-to-one or 
one-to-group workshop basis, rather than on the bas- 
is of an approach geared to the management of collec- 
tive change. Stated another way, district consultants 
themselves are not good knowledge utilizers when it 
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comes to theories of implementation (they may be cjood 
KUs in regard to curriculum -content) ; (b)'districts 
have not set up organized program units as part and 
parcel of system planning and implementation. 

4) One of the greatest gaps in our knowledge is that 
we have only research on district specialists as a 
category . In reality, th6re are many different roles 
and forms of organization across districts. Forj ex- 
ample, it seems that in some cases district special- 
ists may include administrators such as curriculum 
directors, while in others they may be excluded. In 
addition, there are a variety of staff specialists: 
some are general curriculum consultants, others are 
subject-area consultants, and still others provide spe- 
cial services in counseling, special education, and 
so on. In short, more specific research is needed to 
describe and examine the major line and staff roles 
commonly included under the general label of 'district 
specialists. (Fullan, 1981, p. 245) \ 

Superintendents . For years, all major research on educational inno- 
vation has shown the school district superintendent as being critical if 
change is to occur in the system. But Fullan has observed: "However, we 
now know that superintendent 'adoption' of new programs often bears little 
resemblance to 'use 1 of these programs by teacheYs" (pp. 245-246). The 
more recent research literature shows that general support or endorsement 
of a change may mean very little for subsequent implementation.* Fullan 
has distilled" a review of research on the role of the superintendent fn 
KU as follows*: 

In summary, the. findings on the role of the superintendent 
in KU are inconsistent, ad hoc, and incomplete. A series 
of observations and recommendations can best describe what 
we know and need to know. 

1) As a generalization, it ca'.i be suggested that superin- 
tendents are important either for initiating or sup- 
porting KU efforts in school districts. 

2) This generalization does not take us very far. We 
really do not know what superintendents do. Under 
what conditions do superintendents initiate or support? 
What is meant by initiating, and by facilitating? How 
do superintendents in different size school districts 
vary in their roles? What is their relationship to, 



*In Chapter III, one of the remarkable DESSI study findings will show the 
lack of any significant relation between superintendent support and any 
of the several individual or school-level outcomes measured. 
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and what are the roles of, other central office admin- 
istrators^nd specialists (assistant superintendent,, 
curriculum director, district consultants, and so on)? 
One would expect enormous differences in urban districts 
.of 150,000 students compared to small town and rural dis- 
tricts with a few thousand students--the latter o, r which 
make up the large majority of school districts. Nor 
do we know the organizational structure, role.s, and pro- 
cedures as they vary across districts. 

3) In summarizing the research needs in relation to the 
superintendence and KU-, the following points should 
be made: 

« 

a) We need good, basic, demographically representa- 
tive studies of the role of superintendents in KU. 
These' should include how superintendents as indi- 
viduals. use knowledge in their work, and how they 
relate to other central staff and to schools in 

^ initiating, supporting, or facilitating KU. Var- 

iations in the. nature of the role of superinten- 
dents at each of the thr.ee main phases- of mobili- 
zation, implementation, and institutionalization 
should be examined carefully, as well as the pro- 
portion of superintendents who are involved in KU 
efforts at m school districts. As withthe princi- 
pal, studies are needed of how effedpwe superin- 
tendents manage conflicts "and role overload .in 
order to devote some attention to KU for school 
improvement. Size, type, of school district, and 
geographic region would'be the main bases of fram- 
ing the sample. 

b) Similar research should be carried out on. the im- 
mediate subordinates of the superintendent (assist- 
ant and deputy! superintendents, curriculum direc- 
tors)./ These ^central administrators play -a more 
direct role in*KU in many districts, and little is 
known about the work they do, their relationship 

to superintendents, and so on. Not the least of 
th& problem is to come to grips with the niyriad of 
titles and organizational structures, so that one 
can compare practices across districts. (Fullan, 
*t 1981,, pp. 248-249) 

After outlining a ^recommended research agenda for each of the four 
key groups, Fullan made this final statement: 

Y 

The main assumption in this chapter has been that individ- 
uals a x nd groups internal to the district are the most impor- 
tant agents for KU. This corresponds 'to the main -findings 
in;the implementation literature, that the .characteristics 
Of local settings dominate what happens to new ideas (see 
Berman and McLaughlin 1978). If this is the case, the 
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review has identified some critical research gap?, since 
research knowledge about the KU roles of personnel in- 
ternal to the district is very underdeveloped. Current 
emphases in the research literature on federal policies 
and programs (for example, Ralzen, 1979; Turnbull, 1980) 
and external linking agents (Louis,, 1980) are important, 
but shoMld be counterbalanced by equally intensive re- 
search on teachers, principals, district staff, and su- 
perintendents within school districts. (Fullan, 1981, 



p. 251) 
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III. SYNOPSES OF THE STUDIES 



Description of the Scope of the Current Synthesis 

In the immediately previous chapter, we drew heavily on two very 
recent reviews of research by Karen Louis and by Michael Fullan to pro- 
■vide some sense of what these reviews have concJuded from extensive 
surveys of literature in the field of education and in related social 
fields. In this chapter, we shall use a different approach by making 
a far more intensive review of five very recent studies: 

A. Building Capacity for Improvement of Educational Practice: An 
Evaluation of the NIE's State Dissemination Grants Program 

B. A Study of. Dissemination Efforts Supporting School Improvement: 
A Study of Four Federal Programs 

' C. Link-ing R&D With Schools: The Study of the. NIE Research and 
•Development Utilization Program 

D. The Research for Better Schools (RBS) Local School Improvement 
Study * 

E. The RBS Study of Regional Education Service Agencies in New 
Jersey, and Pennsylvania 

The first three are very-large-scale, multi-year studies of major 
federal ly. sponsored dissemination programs that. empl oyed external and 
sometimes local,' linking agents as part of their dissemination strategy. 
The two studies by RBS are much smaller in^scale and in geographic 
scope but add useful additional information. All five of these studies 
provide significant information on the role of external agencies and 
Unking agents as facilitators of local school improvement efforts*. 

Moreover, with the possible exception of the compliance and enforce- 
ment strategies employed by some of the regional service agencies (de- 
scribed by RBS researchers) and the Bureau for the Education of the 
Handicapped Marketing Program strategies (one of the four federal dissem 
inatipn programs studies by DESSI) all the programs studied placed very 
heavy 5 emphasis on var.ious forms of rational knowledge utilization that 
have combined (a)^delivery of externally generated forms of knowledge, 
often representing new curricula, instructional practices, or instruc- 
tional planning and management methods, with (b) various types of knowl- 
edge utilization process assistance. The studies thus report in a 
fairly coherent fashion many variations of one generic school improve- 
ment strategy, i.e., the provision of externally generated knowledge 
along with external human assistance to local schools in its use. 

In sum, more than 40 specific projects/programs are described. The 
studies provide data on more than 400 linking agents who helped schools 
implement more than 200 different innovations. School effects data on 
300 school sites are provided, based on researcher site visits to the 
schools, plus surveys and interviews of more than 4,500 teachers, 
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principals, and other staff. In addition, more than 60 case studies 
of individual school sites were prepared* Excluding the case study 
reports, which total several thousand pages, and scores of interim 
reports, the final, or latest available, reports on which this synthesis 
is based amount to more than 20 volumes totaling more than 1,500 pages. 
In the following sections, we present a summary description of each study, 
includi ng: 

• a brief description of the program/projects studied 

• a synopsis of program assumptions with respect to school 
improvement 

t a description of the study methodology 

• a review of key overall study findings 

• a summary of key findings with respect to linking agents 



A. Building Capacity for Improvement of Educational Practice : 
An Evalu ation of NIE's State Dissemination Grants Program 



' 1. Program Description 

In most states, one or more units in the state education agency 
(SEA) are assigned Responsibilities for disseminating information to the 
education community as a means of facilitating improvement in education. 
Although the activities of these SEA dissemination units differ, they 
generally perform three functions: (1) collect and organize information 
resources, (2) deliver pertinent information to clients, and (3) assist 
clients to varying degrees in using information. 

In 1975, the National Institute of Education (NIE) established the 
State Dissemination Grants Program (SDGP) which provides grants to SEAs 
to help them design, implement, and institutionalize more effective SEA 
dissemination systems. Based on the findings of the Pilot State Dissem- 
ination Program (Sieber, Louis, and Metzger, 1972; Louis and Sieber, 
1979; Louis, 1981), the State Dissemination Grants Program conceptualized 
a system comprised of three components: (1) an information resource base, 
(2) linkages to connect resources with clients, and (3) coordination of 
dissemination activities within and outside the SEA so that clients 
could use the system. \ 

Although linkages between clients and knowledge bases could be accom- 
plished through telephone and correspondence, the Pilot State Dissemina- 
tion Program had demonstrated the effectiveness of the use of field 
agents, analogous to the agricultural extension agent, who made contacts 
with school and district office personnel and engaged in a variety of 
activities. These included helping to define local needs and priorities, 
identifying needs for information, communicating these needs to informa- 
tion resource base staff, delivering retrieved information, providing 
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assistance in applying pertinent information, and arranging for appropriate 
additional assistance. 



2. Program Assumption s 

NIE staff knew that SEAs varied greatly in their organization and in 
their approach to school improvement; hence no one model or approach to 
developing a SEA dissemination system would fit all SEAs. The NIE .capac- 
ity building program focused on thre.e components, (1) knowledge base, 
(2) linkage, and (3) coordination; these were three areas where all SEAs 
might make improvements. Implicit in the focus on building, upgrading, 
and coordinating the SEA knowledge base was the assumption that the ERIC 
system and other information about educational practices, products, and 
programs could provide valuable resources for promoting practice improve- 
ment. The focus on building, supporting, and expanding linkages was 
based on the assumption (well demonstrated in the evaluation of the Pilot 
State Dissemination Project) that these knowledge resources would have 
relatively little impact on practice without the active promotion and 
assistance of personal linkages between practitioners and the informa- 
tion base. The emphasis on coordination acknowledged the fact that in 
every SEA numerous Federal and state programs carried on their own dis- 
semination efforts, often involving SEA units and other organizations 
throughout the state. It was assumed that by exercising leadership, the 
capacity-building project staff could promote coordination of these 
separate SEA knowledge bases and linkage systems so that practitioners 
would gain easier and more effective access to the full range of SEA 
information assistance. 



3. Study Methodology 

NIE issued a contract to the NTS Research Corporation to undertake 
a multi-year (October 1976-April 1980) study of the program. The basic 
objectives of the NTS study were: (1) to describe the state dissemina- 
tion capacity building projects and the SEA dissemination systems within 
which those projects were located; (2) to describe the factors affecting 
the development and institutionalization of SEA dissemination systems; 
(3) to review NIE 's management of the program and its operational pro- 
cedures and to examine how those related to operations at the project 
level; and (4) to derive policy recommendations that might help to 
improve the SDGP and future dissemination programs. Sources of data 
included: (1) two waves of data collection by field interviews, site 
visits, and survey questionnaires (1978, 1979) from the first three of 
five cohorts of projects; (2) additional data collection (1979) from two 
more cohorts of states and from non-program states;* (3) case studies of 



*Although by the conclusion of the NTS study 44 SEAs had participated in 
the program, data on linker service activities and location of linkers 
were described for only 29 states as part of the 1978 and 1979 data col- 
lection effort. A more intensive study of 307 linkers located in ten 
states was also accomplished, and a separate substudy of project direc- 
tors 1 perceptions of linker roles included 25 state project directors. 



five projects; (4) interviews with NIE personnel; and (5) review of 
existing documentation (proposals, quarterly reports, statistical data, 
etc*)* The purpose of ithe study was not to evaluate the success of 
specific projects, but rather to identTfy factors that facilitate or 
impede SEA efforts to build and institutionalize state dissemination 
systems. The study focused on primary program effects, i.e. development 
of dissemination capacity, rather than on secondary effects such as 
client use of that capacity. Thus, the NTS study provides no direct 
information on the impact of the program on schools or information users 
in schools. 



4. Key Overall Program Findings 

The NTS study concluded that the primary effect sought by the pro- 
grams-increased capacity of SEAs to accomplish dissemination--was being 
achieved. States had substantially increased the breadth and variety of 
the knowledge resource bases that could be accessed by clients within 
and outside the SEA. States had developed or increased their capacity 
for delivery of i nformation. to clients through "linkers" who functioned 
as information brokers. Further, the coordination of resources for dis- 
semination had been improved somewhat, although most improvement in this 
area involved increased coordination between the projects and generic 
programs such as the National Diffusion Network (NDN) and ESEA Title 
IV-C innovation diffusion efforts; less coordination was achieved between 
the project and content specific programs such as vocational, compensatory, 
or handicapped education. 

The process of increasing SEA capacity followed different patterns, 
depending on SEA his.tory and context. Resource base development expanded 
primarily in the areas of developing "promising practices" files and 
other state and local information files. Three different linkage pat- 
terns ("controlled/ 1 "coordinated," and "external") were found, tending 
to reflect SEA philosophy regarding its role vis-a-vis local education 

agencies (LEAs) in school improvement. 

<j * 

Factors affecting project succe ss. State, NIE program design and 
management, and other structural factors appeared to influence the success 
of project efforts to implement and institutionalize dissemination systems. 
Favorable state factors included continuity of energetic, entrepreneurial 
leadership; previous experience with dissemination activities; placement 
(placement in an administrative unit favored development of coordination 
and comprehensiveness of the system, but placement in a service unit 
assisted in the delivery of services to clients and enhanced the insti- 
tutionalization of the system in the SEA); initial priority, targeting of 
clients for service with later moves to serve the general clientele; 
active support of top SEA administrators; and absence of stringent SEA 
budgets or changes fn agency leadership. Favorable NIE program design 
and management factors included: collaborative planning between NIE and 
the projects; flexibility of the program guidelines; and provision of 
opportunities to communicate with persons from other states and agencies. 
On the other hand, lack of specification of program objectives in relation 
to other SEA school improvement efforts; vague goals and uncertain means 
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for increasing equity of access and service; and limited NIE staff re- 
sources were factors that inhibited program success. The continued 
fragmentation of dissemination components of other federal programs was 
the major other structural factor that impeded the building of gener- 
alized, and comprehensive dissemination- systems within the SEAs. 



5. Key Findings Regarding Linking Agents 

•* j- 

Location and function * As with the" development of other components 
of the SEA dissemination systems, the SEAs varied widely in the number, 
organizational location, and manner of use of human agents (linkers). 
Among the 29 states surveyed in 1978, some 4,354 persons were identified 
as "linkers." When cross-classified by location and by type of service 
provided, the percentage of linkers were distributed as displayed in 
Table 1. 



Table 1 . Percent of 4,354 Linkers Cross-Classified 
by Linker Service Activities and Location 
of Linkers 





LOCATION OF LINKER 


1 


TYPE OF SERVICE 


'SEA' 


Inter- 
mediate 
Unit 


LETA 

Office 


School 
Building 


TOTAL 


Spread only 


2 


0 


27 


9 


38 


Spread and 
Exchange 


1 


1 


15 


■ 8 


25 


Spread, Exchange, 
and Choice 


2 




2 


0 


4 


Spread, Exchange, 
Choice & Imple- 
mentation 


17 


9 


7 


0 


33 


TOTAL 


22 


10 


51 


17 


100 , 



This table indicates .that more than two-thirds of these linkers were 
located in local education agencies, either in the school district 
office (51%) or the school building (17%). If located in the school 
building, the linkers 1 role was confined exclusively to serving as an 
information conduit ( spread only , e.g., promotion of awareness of 



services; or spread and exchange , e.d, communication of user informa- 
tion needs and delivery of retrieved information). If linkers were 
located at the central office, those were still the most frequent linker 
roles* Less than one in five LEA office-based linkers went beyond y 
information exchange to assist users in choosing among alternatives or \ 
to assist in implementation. However, implementation assistance tended 
to be the major role played by linkers (three out of every four) who 
were external to the LEA, i.e., based at the SEA or in ar> intermediate 
unit. 

Among the 24 states where linkers were assigned implementation 
responsibility, eight different configurations of linker location pat- 
terns were found: SEA only (6); Intermediate Unit only (4); LEA only 
(2); SEA and Intermediate Unit (6); SEA and LEA (2); Intermediate Unit 
and LEA (1); SEA, LEA and Intermediate Unit (2); and SEA, Intermediate 
Unit, and Post-secondary Institution (1).* Half the SEAs that assigned 
implementation tasks to linkers depended on linkers located in only one 
type of agency; the other half of the SEAs used linkers in a combination 
of two or more types of agencies. 

1 Linkers and the resource base . Three predominant models of 1 inker- 
re souFcen)aiT1reTT^ non-coupled, loosely-coupled, 
and coupled. In the non-coupled model the resource base and the linker 
did not have any formally defined ties or relationships other than that 
the SEA resource base existed as a service unit for linkers. In thie 
loosely-coupled model there was greater coordination or cooperation (and 
sometimes formal relationships) between the resource base staff who were 
usually in the SEA jnd the linkers who were usually personnel of inter- 
mediate units, which may or may not be part of the SEA. In the tightly -* 
coupled model, the linkers and the resource base were housed in the same 
SEA unit and reported to the same administrator, thus enforcing a higher 
degree of coordi nation between the two components. 

NTS found that higher degrees of coordination between linkers and 
information resources occurred in projects that utilized cadres of SEA- 
or intermediate unit-based linkers, employed more full-time linkers, or 
were in states that had a higher absolute number of .school districts 
(irrespective of enrollment statistics). NTS also found the coordination 
of linkages was more likely to occur in states that had jiot made an 
attempt to build a maximally comprehensive resource base. Also, coord- 
ination between linkers and the resource base occurred most readily when 
the project first followed a targeted client approach that allowed linkers 
to learn to establish relationships with specific resources and SEA staff 
staff best suited to the needs of particular subsets of the client popu- 
lation, rather than attempting, from the beginning, to meet information 
needs of all classes of clients. 

Relations of linkers to SEA school improvement functions . A second 
primary consideration regarding linker configurations concerned the 
degree to which project linkers were incorporated into the existing SEA 
structure for school improvement* Again three predominant patterns were 



*0nly 11 of the 4,354 agents were located at Post Secondary Institutions. 
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identified: (1) cases where the SEA dissemination functions and its 
school improvement efforts were completely integrated ; (2) cases where 
the SEA dissemination functions and SEA school improvement functions 
operated separately but in a way that complemented or compensated for other 
SEA school improvement efforts--i .e. partially integrated ; and (3) cases 
where the two efforts were totally separate operations (often due to 
differences in location or to differences in philosophy regarding change 
strategies or appropriate roles to be played by a state agency vis-a-vis 
local schools. Moreover, SEAs differed in the degree to which the SEA 
pursued an active school improvement effort (see McDonnell and McLaughlin, 
1982). 

Linke rs and other SEA dissemination efforts . Beyond the issues of 
linker coupling to the resource base, and the relationship of project- 
supported linkers to SEA school improvement efforts, lay the issue of 
the relation between the project and various other linker groups. Among 
ten types of SEA staff, three groups of program linkages were identified: 
1) with dissemination specialists , including resource base staff, National 
Diffusion Network (NDNJ staff, and ESEA Title IV-C staff; (2) with program- 
specific specialists , including staffs of compensatory education, voca- 
tional education, special education, early childhood, adult, migrant, 
and career education; and (3) with state library system staff . Generally, 
the most frequently developed linkages were with resource base staff and 
ESEA Title IV-C and NDN staff (all dissemination generalists ) , and the 
least developed linkages were with migrant education, early childhood 
education, and state library system staff. When examined in terms of 
time trends, most projects were found to have first invol\)d elements at 
the SEA that were organizationally close, and then proceeded to enlist 
persons closer to local schools, most notably intermediate education 
agency staff. 

When examined in terms of relationships with other variables, compre- 
hensiveness of program linkages (extent to which a number of different 
linker groups were involved with the project) was associated with project 
placement in an administrative (as contrasted to a service) unit, with 
the degree to which the project targeted communications but progressively 
generalized its services to all client groups, and with the degree of SEA 
centralization (more centralized SEAs were in a stronger position to 
establish and maintain relationships among their program staff). 

Activities, roles and expectations for linkers . In a separate sub- 
study (Decad, Madey, Royster, and Baker, 1981), NTS researchers took a 
closer look at the actual and ideal patterns of activities as perceived 
by linking agents themselves and # by project directors. In all, seven 
sets of data were examined. Six'involved "real" or "ideal" 5-point (1 = 
never; 5 = usually) ratings of 13 selected linker activities identified ! • 
by Butler and Paisley (1978)* supplied by (a) 136 linking agents in six 



*Butler and Paisley (1978, p. 33) identified 15 linking functions., 
. (See Figure 2, Chapter II.) Only 12 of the ft ems are included in the 
NTS reporting. Two items, Evaluating, and Monitoring Products, were not 
included in the NTS ^instrument. A third item, Managing Conflict, was or 
the instrument but was dropped , 'apparently because it. did not correlate 
very well with any of the other, items. 
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states in 1979, (b) 307 linkers in ten states (including the 136 linkers 
in the first sample), and (c) 25 project directors. The seventh set of 
data comprised information supplied by the 25 project directors concerning 
SEA contextual , project, and dissemination system characteristics, supple- 
mented by additional state and school data obtained from the National 
Center for Educational Statistics. Each of the first six sets of data 
was separately factor analyzed (principal axis analysis solution, followed 
by varimax rotation with three factors retainedMn each solution). The 
resulting factor patterns for the six analyses (three samples by two sets 
of respo&'ses-"actual" and "ideal " ) were highly similar. All yielded 
essentially the same three factors (Facilitating, Resource Finding, 
Communicating). The following paragraphs describe the results for each 
factor.* 

Faci 1 itating . The facilitating role was primarily defined by four 
activities: Implementing (assisting clients to install a new procedure), 
Producing (developing materials or procedures for client utilization), 
Influencing (promoting concepts and ideas for client utilization), and 
Planning (preparing for future needs and services). An additional item, 
Intervening (proactively seeking client needs) does not load highly for 
linkers' activities in the "real world," but was. included in the analyses 
for linkers in the "ideal" world and for both the "reaT" and the "ideal" 
responses af project directors. 

Resource findin g. This factor was primarily defined in terms of thr£e 
activities: Analyzing Problems (translating client problems into information 
and resource needs), Analyzing Information (determining the relevance of 
information to client problems), -and Collecting Information (securing and 
arranging information for client problems). The "ideal" r&sponses of 
linkers and project directors differed remarkably on this factor. In an 
"ideal" world, linkers would add Marketing (promoting ^awareness of available 
services) and Intervening (proactively seeking client needs') to the 1 
resource finding role, but project directors in an ideal world would add 
Monitoring (keeping abreast of recent education practices and innovations) 
and Plan ning (preparing for future needs and services). We thus see in 
the iaeal ratings a common concern with improvement of future services, 
but with a client-oriented bias among linkers as contrasted to a resource- 
base bias among project directors. 

Communication . The communication role was defined most consistently 
across the six analyses in terms of three activities: Communicating 
maintaining open personal communication with clients), Disseminating 
sharing information with clients in a two-way process), and Marketing 
(promoting awareness of available services). However, the loading of 
Marketing was diminished appreciably for linkers 1 ideal ratings. Linkers' 
ideal ratings tended rather to emphasize "planning for future needs and 
services" as part of the communication function. Monitoring ideas (Keeping 
abreast of recent education practices and innovations) showed moderate 



*These three factors extracted 68 percent of the variance in the set of 
12 J terns. Following Varimax rotation, the variance percentages wore 
as Vol lofts: Facilitating (47%) , Resource Finding (13%), and Communi- 
cating (8%). 
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(.4 or higher) loadings for all analyses except the project director-ideal. 
Intervening (proactively seeking client needs) displayed moderate loading 
(•4 or higher] in all three "real" analyses, but very low loading (none* 
higher than .14) in any of the three "ideal" analyses. Apparently the 
need for Marketing and Intervening, i.e., making clients aware of linking 
agents 1 - services and linking agents aware of clients' needs, would diminish 
in an ideal world where presumably agents and clients would maintain 
long-term "communication" relationships. 

When compared to the Butler and Paisley (1978) conceptualization, 
the NTS factor analyses showed that Resource Finding corresponded directly 
to the "resource finding" role described by Butler and Paisley. Facili - 
tating (Implementing, Producing, Influencing, and Planning) involved a 
combination of activities associated with Butler and Paisley's "solution 
giving" and "process helper" roles o . Communicating corresponded to Butler 
and Paisley's "generalist" role. 

Linker types . The next question the NTS researchers addressed was 
how the three I i nker "roles" identified by the factor analyses were 
combined as .linker "types" or profiles. Rather than turning directly to 
cluster analysis or an inverse factor analysis solution, which would 
have preserved rcuch of the available rating scale information, the 
NTS analysis prpceeded by first assigning each linker a "role score" 
based on the average of the ratings for the activity items that loaded 
highest on each factor, then arbitrarily tricotomizing the score into 
High (H) (>3.33 on the 1 to 5 pt. scale), Medium (M) (2.67 to 3\33), or 
Low (L) (<2.67). (Because the averages for items included in the Communi- 
cating role score were approximately one half an item standard deviation 
above the averages for Facilitating or Resource Finding, substantially 
higher proportions of linkers were classified as H or H on Communicating, 
as compared to Faci litating or Resource Finding.) After each linker was 
classified into one of 27 possible types, these types were reduced to 
seven types by ignoring level and looking at relative patterns, j e.g. , a 
"pure facilitator" type might display any of three patterns HLL, HMM, or 
MLL, where the first value is for the facilitating score. Conversely, a 
resource finder/communicator (i.e., not facilatator type) might display 
any of the following patterns--LHH, DOT, LMH, LHM, MHHr-acjain where the 
first value represents the facilitator score. 

In this fashion three "pure" and three "combined role" types were 
formed. Finally, an "eclectic" (undifferentiated?) type was.>recognized 
(i.e., HHH, MMM, LLL) where all three scores fell into the same level.* 



*Placing a linker who rated most items in all three factor sets as done 
"usually" with a linker who rated most items in all three sets as done 
"never" (or "rarely") in the same "type" seems to stress the logic of 
"homogeneity of profiles" past a point of practical interpretation. 



When so typed, the 136 ^inkers (from six states) were classified 
as follows (see Table 2): 



Table 2 . Linkers Classified by Type 



TYPE 


NUMBER 


PERCENT 


Eclectic 


' H 


32 % 


Communicator/ 
Resource Finder 


29 


21 


Communicator/ 
Facilitator 


27 


20 


Commun icator 


• 23 


17 


Sub Total 


(123) 


(90) 


Resource Finder 


8 


6 


Facil itator 


2 


1+ 


Facilitator/ 
Resource Finder 


3 


2 


Sub Total 


(13) 


- (10) 


TOTAL 


136 


100 



Table 2 indicates that "eclectic" linkers, who tend to give approx- 
imately equal frequency to the performance of all three roles, are the 
most numerous type, representing nearly one third of the linkers found 
in this six state sample. However, linkers who placed major emphasis on 
communication-or communication with one other role constitute 58 percent 
of the entire sample. By contrast, TTnkers who place a relatively higher 
emphasis on resource finding and/or facilitating (than on communicating) 
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constitute no more than ton percent of the sample. Clearly, communication 
is the predominant rolo among most of these linkers, however they are 
typed.* 

Compar is on of "real" and "ideal" perceptions of linker activities . 
T-test of differences between means for all 12 activity items and three 
role score averages were computed for all sik possible comparisons 
between linker "real" and "ideal" ratings (from six states) and project 
director "real" and "ideal" ratings (from 25 states). In addition, 
comparisons were made on a descriptive basis between linkers and project 
directors for the six states with linker data. These analyses produced 
the following NTS conclusions: 

1. Communicating and Disseminating are consistently the most ex- 
tensively performed and preferred activities, from both linkers' 
and project directors' perspectives; the least performed and 

fc preferred activities are Intervening (proactively seeking client 
needs) and Producing (developing materials and procedures for 
client util iza'tion. 

2. Linkers want to be more extensively involved in al 1 the activ- 
ities; however, there were qualitative differences between 
their "real" and "ideal" conceptions of their roles, towards 

, wanting to be increasingly involved in the more comprehensive 
functions within the school improvement process. 

3. Project directors' responses were notabl e? in that they 
basically wanted the linkers to perform each activity with 
at least the same relative level of effort; those activities 
that they wanted linkers to do significantly more of tended 
to involve direct services to clients' specific information 
needs and problems. 



*Means for the communicating role are consistently the highest of all 
three roles means for linker real , linker ideal, project director real, 
and project director ideal ratings. Moreover, means for the two activ- 
ities , communicating and disseminating, were consistently the two highest 
means for all four types of ratings. Finally, these were the activity 
areas where "ideal" ratings significantly exceeded actual ratings for 
both" linkers and project directors. From the standpoint of the porpor- 
tions of linkers by types reported in Table 2, it should be noted that, 
of the 136 linkers typed in Table 2, 89 were located at the LEA, 30 at 
intermediate units, nine at the SEA, one at a postsecondary institution. 
No data on organizational affiliation were available for seven linkers. 
With more than two-thirds of the classifiable linkers located in LEAs, 
and given the data on linker service act ivi ties presented in Table 1, 
it is not particularly surprising that the com|P(Jnication;(i.e r , spread 
and exchange) activities would be most prevalent. Jt is also not sur- 
prising that "facilitator types" (i.e., spread, exchange, and choice/ 
implementation) would be so few in number. \More than three- fourths of 
the "facilitator" linkers in the population \see Table 1) were located 
in SEAs or intermediate units, yet linkers from these types of 
organizations contribute less^than one-third of the sample. 

3.11 p.. 
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4. Of all the comparisons, those between the linkers' and project 
directors 1 "real" responses were the most congruent. However, 
some discrepancies did exist. For example, 'project directors 
placed a much lower value on collecting and organizing infor- 
mation; ideally, they would probably delegate this activity to 
a resource base specialist and utilize linkers to a greater 
extent for analyzing client probl&ns and analyzing the resultant 
information package/* Similarly, project directors placed a low 

» priority on producing and implementing activities, probably 
because these activities can be served by others in the SEA; 
for example, media or content specialists may produce materials 
and NDN facilitators may help clients implement new procedures. 

5. The results of the analysis within states seem to suggest that 
there was probably a "wash-out"„effect when responses were 
aggregated^ -across 'states, and that substantial differences do 
exist between linker and project director perceptions. 

* ■ 

6. The analysis within the six states which matched project direc- 
tors and linkers suggests that some activities (e.g., Imple- 
menting, Influencing) may not be clearly defined, and dis- 
crepancies might be attributed to different perceptions of, what 
is involved in performing a particular activity. 

(Decad,- Madey, Royster and Baker, 1981, pp. 42-43) 

A search for explanations of variations in linker regies . Using data 
from the 25 projects where project directors had suppl ied" data on their 
perceptions of linker "real" activities, in conjunction with other data 
on state, SEA contextual, project, and dissemination system characteris- 
tics, NTS researchers undertook a search for explanations in variation 
among the 25 project directors perceptions of real linking agent activity. 
These findings can be summarized as follows: 

t The extent to which project directors perceived linkers performing 
each role ('Veal") was related to project characteristics and 
* characteristics of the linking agents themselves. 

t No relationships were found between perceived linker activity and 
state or SEA contextual characteristics. 

t The extent to which project directors perceived their linkers 
performing the communicating role was associated with project 
directors 1 ratings that their linkers were able to develop 
satisfactory relations with clients, able to undertake and 
analyze a wide variety of problems in a nontechnical manner, 
and able to assist school people in planning and implementing 
new programs contextual ly.- High communicator role ratings were 
associated with projects that used part-time linkers who were 
external to their client organization. High communicating was 
also associated with other personnel who received linker training, 
primarily general ists who were formerly subject-matter content 
specialists. 
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• The resource finding role was primarily associated with the 
number of full-time linkers used by the project irrespective of 
their location the SEA, intermediate unit, or LEA level. The 
major source of support for linkers fulfilling this role was 
intermediate unit funds. Resource finding was associated 
with H the use of school board members and regional and special 
education staff as project linkage elements. 

• Facilitating , perhaps the most comprehensive of the three roles 
since it involves planning, influencing, producing, and imple- 
menting activities, was related to the degree to which various 
dissemination activities of the SEA were coordinated or central- 
ized and also to past participation in the Nine State Study (a 
small-scale, "operational" test of SDGP). This role tended to be 
associated positively with part-time, intermediate-unit-based 
linkers (and negatively associated with full-time linkers) and 
with those who primarily were trained linker specialists (rather 
than generalises ). This role was associated with the availability 
and use of NDN staff. 'Funding for linkers serving the facilitator 
role was positively associated with federal funding for linkers 
(primarily from ESEA Title IV and NDN sources) but negatively 
associated with direct SDGP funding. This role was also associ- 
ated with most of the variables, that measure SEA size, i.e., the 
facilitating role was relatively most frequent in states With a 
large LEA client base. 

• The associations found for faci litating and resource finding 
probably reflect the demands of these roles required by 
linkers performing more complex functions. * # 



* Table 1 indicates that only a third of the SDGP linkers were classified 
as engaging in all four dissemination functions (spread, exchange, choice, 
and implementation). Over 60 percent of the more than 4,000 linking 
agents identified by the NTS study of SDGP provided only M spread M or 
"spread and exchange. 1 ' i.e., primarily communication role services. 
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B . A Study of Disseminatio n Efforts Suppor ti ng School Impro vement . 

# . ^3T T ' 

1. _ Program Description 

In 1978, the United States Office of Education, now the U.S. Depart- 
ment of Education, commissioned The NETWORK, Inc. (Andover, MA) to under- 
take a massive Study of Dissemination Efforts Supporting School Improvement 
(DESSI).* ' As the f i rst step, researchers studied how each of many- existing 
federal and state dissemination programs were structured, how they func- 
tioned, and how they interacted with local conditions and forces. Then, 
in order to develops r?ich array of contrasts and comparisons,' they • 
selected 146 local sites, located in ten states, that had implemented a 
total of 61 different innovations. These innovations were sponsored by 
four different programs, each representing a different approach to school 
improvement. Three programs emphasized dissemination of products and. 
practices developed outside user schools: The National Diffusion Network 
represented the face-to-face approach. The Bureau of Education for the 
Handicapped Market! ng Trogram typified a non-personal materials ,ma>keting 
approach. ESEA Title IV-C adoption-adaptation projects exemplified the 
state-administered dissemination approach. In contrast, the fourth 
program, represented by Title IV-C local development projects, emphasized 
local developmen t of new products and practices. * * 

The primary focus of the DESSI research was on the (tynamics of local 
implementation effort. Each local effort was connected with a single 
federally-sponsored activity, explicitly designed to encourage and support 
school improvement. The four strategies were selected after extensive 
case study of 15 of the 45 dissemination and dissemination-related federal 
programs considered in the DESSI study. The four programs. employ strate- 
gies that can be distinguished in terms of the locus of initiative 
(federal-state-local), the extent of interpersonal assistance (much to 
virtually none), and the locus of such assistance. 

In particular, DESSI researchers wanted to know how various persons 
assisted or inhibited school improvement efforts. They wanted to explore, 
the contributions of those in the immediate vicinity -of the user teacher 
(i.e., other teachers or school staff and the building principal), as 
well as those typically more distant from the daily routine (i.e.,- central 
office staff and facilitators who were external' to the school district.)** 



*The NETWORK was joined in this collaborative study by the Research and 
Development Center for Teacher Education, University of Texas, Austfn; 
the Knowledge Transfer Institute, American University, Washington, D.C.; 
the Center for Policy Research, New York, N.Y.; and the Center for the 
Study of Evaluation, Uniyersity of California, Los Angeles. 

♦♦Methodological ly, the DESSI study approach is clearly the most "site- 
based" of the studies considered in this, synthesis. The-NTS study did 
not provide data on school site effects. The other studies (RBS and 
Abt) do consider site effects, but they both start wi'th identified pro- 
jects and external faciltators who served sampled schools. The DESSI 
study started with a sample of identified innovation sites and then • 
asked who were the facilitators (internal or external). 

.< 
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They were, of course, also interested in many other variables (e.g., 
climate within a building, availability of resources, characteristics of 
the particular innovation) that might explain differences in change out- 
comes. * v 

t 

2. Program Assumptions 

Each of the four programs employed a somewhat different set of 
assumptions. 

A fundamental assumption of the National Diffusion Network (NDN) is 
found in* its emphasis on the use of person-intensive change tactics. A 
second assumption is that innovative programs, developed in schools by 
school people, that have been carefully evaluated in- terms of quality, 
educational significance, and potential transportability, can serve as 
attractive and potent models for innovation adoption in other schools. 
A third assumption pertains to the fundamental nature of diffusion and 
the adoption of innovations. NDN views school -change as a process occur- 
ring over a series of stages; hence emphasis has been placed on develop- 
ment of appropriate materials and tactics by change agents to support 
the change process at different Stages. A fourth assumption of NDN is 
that two types of change agents are needed: State Facilitators and - 
Developers/Demonstrators. Facilitators act as brokers and process special- 
ists, who may assist in identifying potential local education agency' 
(LEA) adopters, and in facilitating the adoption process from initial 
awareness through program implementation. The Developers function as 
program or technical experts <^ho promote their own programs and assist 
clients in adopting and implementing them. 

The state-administered dissemination program (ESEA Title IV-C Adoption/ 
Adaptation Grants) employs a set of - assumptions somewhat similar to NDN's, 
although the primary focus here is on disseminating exemplary innovations 
developed within one state to potential adopters within the same state. 
Although these state administered IV-C programs also place some emphasis 
on interpersonal change tactics, the overall structure tends to be less 
specialized and systematic than NDN. After a typical three-year develop- 
ment period, successful IV-C project innovators are selected for one or 
-two years of additional funding to perform IV-C Developer/ Demonstrator 
(D/D) roles. Other LEAs in the state ^ay apply for small Title IV-C 
adoption/ adaptation grants. Typically, state. agency Title IV-C staff 
play the facilitator role, especially in creating awareness and helping 
to serve as brokers between IV-C D/D's and adopter sites. In some states, 
the process approximates a "state-le^el NDN, n but in other states, the 
human change-support functions are much less developed, and LEA adopter 
initiative plays a much larger role. 

By contrast, the BEH Marketing Program assumes that the essential 
features of an effective educational practice can be identified and 
communicated via packaged information and disseminated by educational 
marketing methods. Consequently, this approach employs an additional set 
of underlying assumptions. LEA staff are presumed to have the requisite 
motivation, knowledge, and skills, and will not need external assistance, 
for identifying needs, selecting appropriate resources, or undertaking 
the processes of start-up and implementation of a practice. 
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The loca 1 devel opment/i nvention progra m (ESEA Title IV-C) assumes 
that one means of promoting improvement-oriented change in schools is 
through the provision of "seed money" that would allow LEAs to'install 
new projects that they probably could not undertake without special 
funds. It is assumed that such external support would be needed only 
for a limited period .(typically no more than three years) while LEA 
personnel put the new practice into operation and evaluate its effective- 
ness.* It is further assumed that LEA staff best know their own resources 
and capabilities and are thus in the best position to decide if a portion 
of their funds should be used to obtain assistance external to the LEA. 



3. Study Methodolog y 

Representing a stratified random sampling of selected programs and 
lnnovation^an ten states, 146 sites were selected.** Using questionnai res 
and interviews, the DESSI researchers surveyed teachers (N=366) involved 
in innovation development and implementation, their principals and super- 
intendents (N=284), a smaller group of central office staff (N=78) who 
were actively involved in supporting innovations at 65 of the 146 selected 
sites,, and individuals from outside the district (external facilitators) 
who had been funded to assist in the various improvement efforts (N=96). 
In addition, a specially designed questionnaire was administered to the 
total faculty of each school building (N=3129). In addition to the 
extensive survey data, DESSI also deployed a field team of ethnographers 
who visited each of 12 schools several times over the course of the 1979- 
1980 school year in order to develop indepth case studies of selected 
' sites. 



4. Key Overall Program Findings *** 

From the perspective of this synthesis report, perhaps the most 
important DESSI finding was that the successful transfer of new practice 
is not just a matter of providing information. Without face-to-face 
disseminators, implementation does not occur. This point is summarized 
succinctly by Cox and Havelock (1982). They note that when the DESSI 



*Note: The successful local IV-C programs can compete to become the 
exemplary innovations disseminated by the state-administered IV-C 
dissemination program or they may become NDN Oeveloper/Demonstrators. 

*The 146 schools included elementary school (56%), middle school /junior 
high school (13%), senior high school (26%), and other f5%) levels. 
The schools were located in urban (12%), suburban (35i%), and rural (53%) 
areas. Schools ranged in size from 18 to 3,092 students (mean = 611). 
The sample thus represents substantial geographic, demographic, school 
level, school size, and urban-rural diversity. 

*Final formal reporting of this study has not been completed. Thus, 
results from t he J)ESS I study are based on review of papers presented 
at the 1981 anS'the 1982 AERA annual meetings. 
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researchers attempted to locate schools that were actually using prac- 
tices promoted by the BEH Marketing Program, they exhausted their pool 
of nominated sites (over 200) and found only 17 that were using the 
practices in ar\y way. 

A second major finding was that two fairly independent processes 
were at work in school improvement efforts. One results in change in 
classroom practice (the individually-focused model). The other results 
in organizational change and institutionalization of new classroom 
practice (the school-focused model). External agents need to be aware 
that different behaviors influence different processes and produce differ- 
ent outcomes. 

When the DESSI researchers looked at the individually focused model, 
they were initially frustrated because they found no significant dif- 
ferences in outcomes (perceived benefits, change in practice, practice 
specific mastery, and fidelity of adoption) for various combinations of 
many predictors. After intensive examination of data on a case by case 
basis, they speculated that users for whom a new practice represented 
a major change from what they knew and did previously would be involved 
in fundamentally different change efforts than those for v;hom an innova- 
tion represented only a minor change in their instructional procedures. 
After dividing the sample into these two groups, they discovered two 
quite distinct patterns. 

Minor change . After several iterations of a structural equation 
model for the minor-change group of teachers, each time removing vari- 
ables of little consequence, they found a picture of extreme simplicity 
(Crandall, Bauchner, Loucks, and Schmidt, 1982, p. 8). For example, 
with change in practic e as the outcome of interest, they achieved a 
significant result (R^ = .45, p < .04) for a group of 75 "minor-change 1 / 

users (in 52 sites) with only two predictors^ ^teacheji^conTmltment- and — 

elap sed- time ;* None of the assistance variables ( school -1 evel , di'strict- 
Tevel, external) played important roles in producing the outcome, nor 
did the time spent on implementation-related activities (e.g., time 
spent on materials selection/ development, training, evaluation, or com- 
municating with-otfiers about the innovation). The passage of time and a 
sustained personal effort was sufficient to account for differences in 
changes in practice when only minor changes from previous practice were 
involved. With respect to external change agents, Crandall (1982) ex- 
plained, "If the new Practice is really not very different from the 
current practice, the pnly thing that a disseminator can do is to give 
teacher? information about the new practice and then leave them alone. 
Disseminators should not invest a lot of time in these sites, because 
there is no discernable way to enhance the outcome. Indeed, the presence 
of an outsider rapidly becomes negative." 



* The statistical shorthand (R2 = .45, p < .04) indicates that the multi- 
ple correlation squared (R2) equalled .45, i.e., accounted for tt 45 percent 
of the total variance in the criterion measure, change in practice ; and 
that the probability of a multiple correlation of this size arising due 
-to chance was less than 4 in 100 (p < .04). 
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Major change . The major-change sample (88 teachers and 48 sites) 
terided to produce more complex predictor to outcome relationships. 
Pertei.ved benefits appear to result primarily from the change in pra ctice 
achieved by the teacher, principal help given to teachers, and external 
assistance (RZ = -42, p < .01)/ Change i n teacher practice is enhanced 
primarily by classroom use of the practice, and secondarily by readiness and 
local faci litator help , but tim e spent on materials and external agent 
help detract from teacher practice change (R^ = .49, p < .04). Surprised at 
the negative influence of external agent help, the DESSI researchers 
"unbundled" their composite external assistance variable, and then found 
that a positive contribution by external agents is made by activities 
directed to particular user's implementation efforts (e.g., planning 
implementation procedures, assisting teachers in working out procedural 
details, and providing specific follow up technical assistance.) Pra ctice 
specific mastery , measured by Levels of Use (Hall, Loucks, Rutherford, and 
Newloye, 1975) appears to be primarily the product of time spent on 
materials and time spent on communicating about the practice (R2 = .50, 
p < .04). Finally, fidelity of the rrew practice to the form stipulated by 
its developer was the result of teacher ti,me spent on classroom use and 
principal help , the latter being a direct effect unmediated by teacher 
time (R* * 753; p < .02). 

Since the way teachers spend their time emerged as a matter of. central 
importance in predicting outcomes, the DESSI researchers searched for its 
antecedents. Only teache r cDmmitrnent emerged clearly as a primary ; ' 
predictor of both classroom tjme and evaluation time . Unfortunately, 
none of the avail-able variables in the individual -level model (assistance 
at any level, teacher characteristics, or resource availability) signifi- 
cantly explained teacher commitment.* However, the importance of teacher 
commitment was underscored by its appearance in subsets of the sample. 
When, the local (-IV-G) development sites are removed, leaving a pure 
"dissemination only" sample fc of 61 teachers (in 35 sites), the teacher 
change 4 outcome variable is explained almost exclusively by teacher 
commitment (RZ = .65, p < .03). For the NDN sample alone (a sample of 
42 teachers and 20 sites) teacher commitment, along with school-level 
assistance, also yielded a significant teacher change in practice outcomes 
(R2 = .61, p < .0 , . 

School -focused model . Although the main concern of the DESSI re- 
sear cherTTay^viTth understanding the factors affecting classroom-level 
adoption practice, they recognized that for these practices to have 
lasting Effects, the practice needed to becomeinstitutionalized Three 
related measures of outcomes were examined: institutionalization , defined 
as the degree to which the practice became a regular aspect of school 
life which is not dependent upon present personnel; organizational change , 
defined as those benefits which affected more than individual teachers 
or students; and plans f or contin uation, defihed as the likelihood tliat 
use of the practice was either eliminated, reduced, maintained, or expanded. 
In this model, all sites with no missing data were includede{N=8?7, 



*However, in the school -focused model, considered next, teacher control 
over the practice and local facilitator assistance emerged as significant 
positive predictors of teacher commitment. 
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regardless of whether a major or minor change was being attempted. 
After several iterations of the structural model (using a maximum- 
likelihood approach), there emerged a relatively complex pattern of 
relatiohship depicting two distinct but interrelated patterns of vari- 
ables. One pattern dealt with teacher or instruction-related variables 
and the other with organizational variables. The major link between 
these two patterns was the school principal (principal commitment, 
principal help, principal management style). However, other actors(also 
emerged as being critical to success. 

Organi zational change and institutiona l z a tion . The ext ernal agent's 
hel£ was the main predictor of organizatiohaT^change , whicFTh turn was 
tFe~only significant path to institutionalization / Indeed the DESSI data 
indicate that a f ter introducing the new practice, this area seems to be 
the one where external agents make th,eir most positive contribution to 
practice improvement. In addition to the crucial role of the external 
agent in producing this outcome chain (organizational change and then 
institutionalization), the principal played a central role. Principal 
leadership (defined as the degree to which the principal actively focuses 
the direction of activity in the school building) was also an important 
positive prgdictor of organizatio n al change . 

The DESSI researchers note: 

These scores [management style and leadershi p ], based 
on the judgments of the entire faculty, describe an 
in-charge professional --one who knows what's happening 
and is directing it. These schools are not "loosely- 
coupled, " 

(Crandall, Bafichner, Loucks, and Schmidt, 1982, p,' 20) 

The third measure, plans for continuation , was significantly related 
to three predictors: positively to principal commitment , positively to 
principal leadership , and negatively to p ersonal gains (those benefit^ 
reported by users that accrued to them as individuals, versus those 
associated with student growth). However, plans for continuation was 
not significantly associated with organ;rzirtiona>l change or with 
institutionalization. 

Instruction- r elated variable s'. Two subpatterns were found here. 
In one subpattern we see principal management style , principal commitment , 
and pro-active probl em solving' (defined in terms^of faculty pe rceptions 
that effective procedures exist for solving problems and implementing 
actions) were all direct antecedents of principal help (received by 
teachers), which in turn related (positively, but with borderline sig- 
nificance) to practice-related master y by teachers. Both school size 
and di strict size operated as interesting contextual variables here, " 
Large districts were positively associated with greater staff r eadin ess 
to implement the practice, greater principal commitment and principal 
l eadership , greater teacher commitment , and greater user practice-related 
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mastery. However, large scho ols were asociated with lower readiness 
and lower principal commitmen t, but greater principal leadership . 

As noted previously, external facilitator help primarily affected 
organizational change and institutionalization. Local facilitator help , 
which enhanced practice change and perceived benefits in the individually- 
focused models for teachers implementing major changes, operated in the 
school -focused model as a significant antecedent to teacher commit ment* 
and to predicting problem alleviation (report by users as to whether — 
the new practice solved problems which they have grappled with for some 
t i me ) . 



5* Extern al Facilitators * * 

The DESSI sample of external facilitators contained 95 respondents 
from whom they collected data using four different instruments: (1) a 
questionnaire and (2) an interview, both concerning general aspects of 
their work as external -facilitators; (3) a questionnaire and (4) an 
interview focusing on assistance given to a particular site. However, 
only 80 external facilitators provided interview and questionnaire in- 
formation on 132 cases of assistance to 97 q§ the 146 sites that were 
included in the study sample (the number of sites per respondent ranged 
from 1 to 5 and averaged 1.6 per respondent). Among the 95 external 
facilitators in the sample, more than half (51) were,.NDN Developer/Demon- 
strators. The remainder were nearly evenly divided among: State-Admin- 
istered IV-C Developer Demonstrators (17), NDN State Facilitators (15), ' 
and Locally Developed IV-C Project consultants and trainers (12). Thus, 
more than two-thirds of the external facilitators (6b out of 95) were in 
NDN or State IV-C Developer Demonstrator roles, with the remainder nearly 
evenly split between NDN.State Facilitators and local IV-C project consult- 
ants and trainers. Programatical ly, the sample is dominated by NDN 
respondents (66 of 95).*** Hence, the picture of external facilitators 
provided by DESSI data was primarily focused on one program, NDN, and on 
onerole, Developer/ Demonstrators. However, because the sample is not 
totally represented by one program or one role, some variation across 
programs and roles existed, but unfortunately the other roles (NDN state- 
facilitators or local IV-C- consultants or trainers) and other programs 
(state IV-C; local IV-C) w^re not represented in proportions that afford 



*0ther significant predictors of teacher commitme nt besides local 
facilitator help were teacher control (extent to" which teachers believe 
they control and can influence their implementation effort) and larqe 
district size . 

**mq«^ S described in this secti °n are drawn mainly from Cox. and Havelock 

***Nearly the same proportions emerge when total sites with identified 
external facilitator respondents (N = 97) were classified by program: 
NDN = 68; state-administered IV-C = 20; and locally developed IV-C 
projects = 9. 
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very powerful contrasts* The NDN D/D's alone represent over half the 
sample of external agents (51 of 95)* 

* * ♦ 

0 

Assumptions of the programs included in the DESSI study were de- 
scribed previously. It may be useful here to present the Cox and 
Havelock (1982, p. 6) description of these roles: 

Because their primary [NDN] aims have been to spread 
exemplary practices, they have emphasized extensive 
services over intensive. While State Facilitators help , 
with arrangements for adoption, and 1 Developer/Demonstrators 
provide training in the practice and some support, the 
fitting of the innovation is left largely to the locals. 
Considerable [NDN] assistance is given away from the actual 
implementation site, in group training sessions or, in the 
case of follow-up help, through telephone conversations. 
The picture of the Title IV-C assisters is more varied . . . 
some of these consultants worked on a long-term basis 
with a site through the whole planning/implementation 
process; others provided components of practice without 
much involvement J n the site; still others worked intermit- 
tently through the planning/implementation process, contri- 
buting heavily at the evaluation phase." 

Cox and Havelock have pointed out that one should not 'assume that 
assistance from the external facilitator means help rendered on the 
site, face-to-face, or continuously. Indeed, out of the 131 cases of 
assistance, the external agent respondents said they were familiar with 
the practice at the selected school-building site in only 48 of the ' 
cases; in 83 of the 131 cases they^said they were not f ami li ar with the 
practice at the site. However, familiarity varied substantial ly by role 
group (and the data present a different overall picture when viewed in 
terms of agents rather than sites ). Perhaps because local IV-C agents 
were hired by the local IV-C sites, these agents indicated they were 
familiar with 75 percent of their sites. Next, were the state IV-C 
agents who stated that they were familiar wrth 58 percent of their sites. 
NDN D/D's were familiar with 27 percent of their sites. The NDN State 
Facilitators, who generally play more of a brokering than a direct imple- 
mentation assistance role, were familiar with the practice at only 25 
percent of their sites. 

Cat egories of facilitator assistance . Cox and Havelock examined data 
provTded by external facilitators concerning their activities with specific 
sites (30 items grouped into five categories). The sample (N - 88) as a 
whole spent a little more than half their work time interacting with 
clients. The remaining time was spsnt on routine professional tasks 
(e.g., administration, travel, professional development and inhouse product 
development). The portion of their time spent with clients was distributed 
across five (temporally ordered) categories as follows: (1) initiating 
relationships (e.g., holding awareness, conferences, distributing flyers), 
25 percent; (2) assisting clients in deciding on new practices (e.g., 
assessing needs, persuading teachers, seeking support), 16 percent; (3) 
assisting clients in preparing for adoption (e.g., training users, securing 
materials), 26 percent; (4) assisting clients in implementing practices 
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(e.g., planning implementation schedules, "gutting out fires")-, 19 
percent; and (5) follow-up activities (e.g., collecting impact data, 
assisting in local site evaluation), 15 percent. Thus, half their client 
time was spent on initiating relationships and assisting in adoption 
preparation. The other half of their client time was spent helping with 
practice selection, implementation, and follow-up. 

Factor analysis of facilitator activities . The 30 activity items had 
been classified a priori into the five categories named above. However, 
factor analysis of the 30 items indicated that the empirical organization 
oT the items was a little different. Twenty-seven of the 30 items displayed 
appreciable loadings on one (or more) of the seven factors displayed in 
Table 3.* . . 



L a AL?_J?.' External Facilitator Assistance Factors 



• Awareness Initiation : arranging or participating in awareness conferences; 
distributing general" information (e.g., /lyers, newsletters); hosting visits 
to review materials; holding demonstration visits; contacting new clients by 
mail, telephone, or in person. 

• Administrator Adoption Preparation : seeking commitment from school admin istra- 
tion; seeking support from local school boards; preparing a "case" for the 

decision to adept; working with administrators; allocating financial resources. * 

• Support of Teachers : seeking commitment; building support among school ^rson- 
nel ; maintaining support among school personnel. 

• Teacher Adoption Preparation : arraogi ng'traini ng; training the users; providing 
detailed information; securing materials or other required resources. * 

• Implementation Specifics : planning implementation schedules; providing techni- 
cal assistance v or follow-up training; assisting teadhers in working out pro- 
cedural details. * 

• .* 

t Evaluation : collecting impact data; analyzing impact data; assisting local site 
to conduct evaluation of new practice. 

• Con t i nua t i on/Pi f f us i on : developing plan to support continuation; developing 
additional new users at site. 



*Three assistance items did not have high factor loadings on any of the. 
seven factors. These items were: "making library and computer searches 
for materials" (one of the least often performed and least "important" of 
the activities as rated by the respondents); "fighting fires" (which was 
rated "most dislikgci" by a large portion of the sample); and "assessing 
needs". 



9 
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Differences in activities among types of external facilitators . * 
Using the sevea factors as a basis^ for cal culating. mean scores for each 
role group, Cox and Havelock reported the perhaps not unsurprising findin'g 
that the five role groups did display some differences on adjusted factor 
score means for frequency of performance. Over all five groups (unweighted 
averages of rankings of the seven factors within each group), Teacher 
Adoption Preparation tended to be the highest ranking (most frequently 
performed) set of activities, followed by Awareness Initiation, Implemen- 
tation Specifics, Support of Teachers, Administrator Adoption Preparation, 
Evaluation, and then Continuation/Diffusion. When factor scale means 
were examined across the five role groups, two -of the seven sets of means 
displayed statistically significant differences: Awareness Initiation 
(p < .001) and Teacher Adoption. Preparation (p < .015). Awareness and 
Teacher Adoption Preparation activities were among the most frequently 
performed activities, ranking either highest or next highest among the 
seven factor score means for all role groups, except the local Title IV-C 
facilitators. The local Title IV-C facilitators were much less often 
engaged in Awareness Initiation activities (ranked as least frequently 
performed of all seven factors) and relatively less often engaged in 
Teacher Adoption Preparation (however, in this case, it still was the 
third most frequently performed type of activity). If local Title IV-C 
facilitators tended to place relatively less emphasis than the other 
four role groups on Awareness Initiation and Teacher Adoption Preparation, 
where was their emphasis placed? On providing Implementation Specific 
assistance (most frequently performed") and on providing Evaluation 
assistance (next most, frequently performed). It should be recalled that 
facilitators involved in local Title IV-C projects were often called in 
by the site project well after the adoption/implementation process had 
begun and often to perform relatively specific assistance tasks. 
Differences among the other four role groups appeared to be minimal.* 

Impact of External Facilitator assistance on school improvement . We 
have previously reviewed the Crandall et (1982) findings based on the 
construction and test of two causal models (indi vidual -focused and school- 
focused). Cox and Havelock, reviewed these models with special attention 
on the external facilitator. The school-focused model displayed the 
clearest evidence of positive impact of the external facilitator. Here 
External Facilitator Help had a significant positive effect on Organiza- 
tional Change , defined as those benefits (reported by principals) that 



* Unfortunately, Cox and Ha(elock did not report means and standard 
deviations, only rankings of means. Hence, secondary analysis of their 
reported data does not permit a sensitive test. However, we note that 
the rankings (across the seven factor means) were highly similar for the 
other four groups (no more than one rank difference among the four groups 
on six of the seven factors and only a two rank difference among the four 
groups, on the seventh factor (Implementation Specifics)". Although Cox 
and Havelock did not draw this conclusion, their reported data suggest 
all four of their "pure" disseminator role groups (i.e., NDN-SFs ; 
NDN-D/Ds; Title I D v /Ds; and State-Admini stered D/Ds) were remarkably 
similar in their relative emphases of assistance roles, whereas their 
local Title IV-C group (N=12) was indeed very different in its pattern 
of activities. 
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had impact on aspects of school life other than individual teachers or 
students. In order of frequency of mention, these included: instruc- 
tional methods, staff soci o-emotional state, materials, planning/schedu- 
ling, organizing, staff 'communi cation, increased number of staff, and 
assessment. In this school-focused model, Organizational Change is the 
only variable that had a significant effect on Institutionalization . 
Cox and Havelock provide additional information demonstrating that the 
benefits, as reported by principals, matched fairly closely the types 
of required changes as reported by external facilitators. 

When the individually-focused model was examined for evidence of 
external facilitator impact, two different pictures emerged, depeqjding 
-on whether one looked on the "large change" or "small change" teachers. 
External facilitator had litle impact on the small change group, except 
that, in a secondary analysis, the assistance measure, Teacher Adoption 
Preparation was positively related to the time spent by teachers in 
training. 

The results for the most-change group are more complicated and 
troubling. In the primary analysis, the DESSI researchers found that 
External F acilit ator Help had a significant n egative impact on Change in 
Practice . However, severa Secondary analyses that unbundled the txternai 
FacilUator Help measure indicated that some aspects of the facilitator 
help were, positive though others were negative. It appeared that two of 
the severi External Facilitator Assistance Factors (see Table 3), Imple - 
m entation Specifics and Continuation/Diffusion , were the only external 
assistance measures that directly or indirectly had a positive, sig- 
nificant impact on individually-focused outcome measures. Both these 
factors included items that dealt with fitting or maintaining a practice 
in its new environment, e.g., planning implementation schedules, provid- 
ing technical assistance or follow-up training, assisting teachers in 
working out procedural details, developing plans to support continuation, 
and developing additional new users at the site. It thus appears that 
the more assistance given to teachers in working through the processes 
of the practice in its local context , the more impact external facili- 
tators are likely to have". Tbx and Havelock cited a, companion DESSI 
report by Huberman and Miles (1982).. After an exhaustive review of a.l 1 
assistance, both internal and external, given to the 12 sites included 
in the DESSI ethnographic study, Huberman aad Miles concluded that assis- 
tance made more of an impact in local sites seeking to implement large- 
scale innovations. High assistance, involving both external and local 
facilitators, that was sustained through later implementation, had the 
following outcomes: stabilization of practice, increasing cohesi veness/ 
trust, reduction of isolation, building an implementation "team" and 
building an assistance infrastructure, coordination and collaboration. 
Huberman and Miles note that "the message here is that a high assistance 
presence moves its client systems away from loose coupling as a way of 
life."* 



♦Huberman and Miles, 1982, p. 152; quoted in Cox and Havelock, 1982, 
p. 21. 
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C. Linking R&D with School's: The Study of the NIE Research . 
and Development Utilization Program 

l.** Program Description . ^ - 

In June of 1976, the National Institute of Education established 
the Researched Development Utilization (RDU) Program as' an experimental 
effort to combine R&D-based products with rational problem-soLving methods 
to help schools clarify and solve local problems. The RDU Program was 
designed^to achieve three objectives: 

t to help schools identify and find ways to solve speci^c,^ 
local ly-def ined^problems in the areas of basic skills aftd 
career education; * 

t to help school and community personnel learn about ^he 
products of educational research and devel opment; and 



n 

t to increase % understandi ng of how the local program . 
improvement .process could be better managed and become 
more effective, * 



t 

♦ 



er|c 



The RDU Program was unusual among federally-funded dissemination 
strategies because of its very heavy and dual emphasis on dissemination 
and use^' of R&D productsand on development of local organizational 
capabilities to apply systematic problem identification and solution 
processes. The NIE program was also unusual in terms of its explicitly 
experimental nature. Although the NIE solicited proposals from and^ 
funded projects in agencies that appeared capable not oply of. implement- 
ing the generic RDU program design,^ but also of institutionalizing the 
program, RDU was explicitly designed as an experiment to test a series 
of assumptions about R*D utilization, • v , 

The RDU Program's orientation was action research^ About 77 percent •» 
of the effort supported sevenoperational projects providing cforect ser- 
vices to schools, whereas about 23 percent of the effort was directed to 
the study of how, these services were organized and del ivered^and their 
effects in terms of implementation and outcomes at local sites. The 
service delivery system pf the RDU program operated through"seven region- 
ally dispersed projects, each of which established and coordinated a 
network of organizations and individuals. As a whole, the seven projects 
operated in 20 states and served more, than 300 schools or school districts 
over a three and one-half year period, 1976-1979 (Louis, Rosenblum, 
Moll tar, and others, 1981a). 

Many significant commonaln ties among the seven RDU proejcts were 
the result of NIE specifications contained in its Request for Proposals 
(RFP). Specifically, the NIE sought proposals that would: 

t attempt to increase knowledge and utilization of R&D outcomes 
as part of the solution to locally-defined problems, 
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t attempt to orchestrate a much fuller range of change support 
services than had character izxed previous R&D dissemination 
efforts, and 

t attempt to create arrangements among a variety of existing agencies. 
The RFP specified that proposals make explicit provision of assistance 



t delivering technical assistance to local schools through the use 
of "1 inking" staff, 

t identifying specific educational problems at each school site, 

t developing -and using information on available R&D-based outcomes 
(products,, programs, practices), 

t selecting and adopting specific R&D outcomes based on locally 
developed criteria and needs, and 

t implementing the selected R&D-based programs at the local site. 

The RFP also contained specific requirements for establishment of 
management \ nformation systems, documentation, evaluation, and reporting. 
The fundedprojects submitted proposals that were responsive to 'these 
general'specifications. Consequently, there were many ways in which the 
seven RDU projects were similar to each other (and also remarkably dif- 
ferent from virtually all other federally-sponsored educational dissem- 
ination efforts). However, the RFP deliberately provided for a diversity 
of approaches (by inviting proposals that involved various intrastate 
and interstate organizational arrangements; addressed different subject 
matter emphases in basic skills and career education; and employed dif- 
ferent strategies, tactics, and linkage arrangements among organizations). 
The following brief descriptions' provide an overview of the projects 
with special emphasis on distinguishing features and characteristics. 

The seven RDU projects . The seven RDU projects can be described as 
natural or f i eW-dessgned variations of the general RDU design. Four of 
the projects were located in individual states (FL, GA, MI, fA) and were 
headquartered in the state education agency. Their prime linkage with 
schools was through intermediate agencies, although other resource groups, 
such as university or non-profit service and training agencies, were also 
part of some project configurations. The other three projects were 
consortia* each involving schools and intermediate agencies in more than 
one state. 

The Florida Department of Education was the prime contractor in a 
linkage' system that involved the state universities (especially Florida 
State University and the University of Florida), and eight of the state's 
Teacher Education Centers (T^Cs). The intent of this project was to 
create an infrastructure (legi slative,* interorganizational , and technical),, 
the Florida Linkage System (FLS), to support a combined effort by the 
Florida Department of Education, the state universities, and the Teacher 
Education Centers to assist schools. Developed as an outgrowth of 
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several previous dissemination projects,^B4S featured training in group 
problem-solving techniques that was provided not only to the field agents 
(one located in each of the eight TECs), but also to selected school 
staff. School site facilitators, with the help of the field agents, 
were responsible for leading the staff at their sites through the entire 
RDU problem-solving process. 

The Georgia State Department of Educa tion project aimed to create 
a permanent state network, consisting of the Department, Cooperative 
Education Service Agencies (CESAs), aqd participating school districts, 
that would be able to generate inner-directed change in schools. The 
emphasis of the Georgia RDU project was on building local school district 
capacities in the ear.ly stages of planning and program selection, with 
theMmplementation phase supported with federal ESEA IV-C funds and 
state funds. The project also involved a concerted effort to reorient 
and train Department and CESA consultants ^as problem-solving "general ists." 

The Career Education Dissemination Project of the Michigan Department 
of Education was designed to develop statewide capacity to implement 
Michigan's Public Law 97, "Career Education Act," through the creation of 
a permanent dissemination system in career education. The project employed 
existing structures and personnel located in the Department in the state's 
50 Career Education Planning Districts to channel information and to 
provide direct training and funds. to career education coordinators who 
were staff members at local sites. 

Building on a 15-year Education Quality Assessment Program, the 
Pennsylvania School Improvement Program of the Pennsylvania Department 
of Education developed an interorga nizational arrangement involving the 
Department and three experienced R&D agencies Research for Better 
Schools (a regional education laboratory); the Learning Research and 
Development Center (an educational R&D center at the University of 
Pittsburgh); and Research and Information Service for Education (RISE, 
a statewide information and dissmination service) -- to provide R&D 
services in cooperation with two of the state's Intermediate Units to a 
number of participating schools. Drawing on the extensive school improve- 
ment experience of several agencies, the Pennsylvania project focused on 
helping sites to form Local Action Teams that then proceeded through a 
series of defined problem-identification and problem-solving steps. 

Whereas the R&DU project antecedents for the four single state pro- 
jects were all rooted in previous state di ssemination ; and technical 
assistance efforts and were responsive to state department priorities 
and state legislative mandates, the following three multi-state projects 
found their programmatic roots and relationships in pre-existing, nation- 
wide programs (i.e., Right to Read, NEA's Instruction and Professional 
Development thrust, and the National Diffusion Network). Jt was through 
these program networks of shared school improvement ideology and personal 
relationships that multi-state partnerships were recruited and enlisted. 

The Northwest Read ing Consortium , with the Washington State Education 
Agency as prime contractor, operated a consortium of four states: Alaska, 
Idaho, Oregon and Washington. Built on the national Right to Read (R2R) 
Program and seen as providing significant refinement of the R2R change 
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strategy, this project took advantage of a history of interstate cooper- 
cation in the Northwest in an explicit effort to improve interstate and 
intrastate communication and dissemination capacity 'in this region* The 
Northwest Regional Educational Laboratory ; was a Consortium affiliate that 
provided training to project staff and support in the development of a 
i pool of R&D products. % \. 

The National Education Association (NEA) operated its project in 
collaboration with NEA state affiliates and state educatio/i agencies 
in 12 states: Alabama, California, Iowa, Massachusetts, Michigan*, 
Minnesota, Ohio, Pennsylvania, Tennessee, Washington,' Wisconsin, and 
Wyoming. The fundamental premise of the NEA project was that' imprpvi ng 
teaching strategies and effecting desirable change in the teaching/learn- 
ipg situation, through strengthening instructional- and professional (de- 
velopment of school staff, would contribute to^ the amelioration of edu-; 
cational problems in the busic skills. Thus, in contrast to. the- QtheV- 
RDU projects, the NEA project focused exclusively on. the improvement 
of teacher inservice education/ Services were provided by two field 
agents in each state, one in the SEA and the other in ttje NEA* state 
organization who trained local staffl J % " 

* •» 

Building on the established expertise and, dissemination capability 
of the NETWORK of Innovative Schools and of the National Diffusion Network 
(NDN), the NETWORK, Inc . , a non-profit organization* jn Andover;*>Mass.., 
coordinated a consortium of NDN-aff iliated dissemination agencies'in six 
states: California, Connecticut, Kansas, Massachusetts, Minnesota, and 
t Washington*/ Concentrating on basic reading skills i*nd ,on the change pro- 
cess itsellf, the project prescreened many candidate R&D'products' and 
change support processes, created a highly selected initial pool of R&D- 
based resources, and employed experienced NDN field agents to provide 
assistance to local schools. . , , % v 0 

When compared to the four single state projects, the three mlilt'i- 
state projects tended to centralize significantly larger portions of 
support operations (e.g., information services, training, .evaluation} at 
project headquarters. However, there were major differences. ^ The 'NETWORK 
was the most concentrated and self-sufficient, NEA was intermediate, and 
the Northwest Reading Consortium (the one state education agency/prime 
contractor) was the closest to its single-state SEA project cousins in 
its tendency to subcontract all or, part of its information, training,- 
and evaluation support functions. 

Conceptually and operationally, each of the seven projects confronted 
accomplishment of change on at least three levels: (1) change in v the 
classroom. behavior of individual teachers, (2) change in the organization 
of schools and their staff as problem-solving entities, and (3) change" 
in intraorganizational and interorganizatibnal relationships, including 
development of suppont systems and reorientation and training of personnel^ 
to assume new or improved linking agent and linking suport roles. Though * 
the single-state projects were* concerned with developing organizational 
systems that could cope with the intra- and interorganizational realities 
of several levels of educational bureaucracies within a state*, the ftulti- 
state projects confronted the special problems. of maintaining. extremely 
dispersed organizations that depended primarily on 'the knowledge, skills, 



and motivations of field agents who had to work far more independently. 
Because of the greater geographic distances and looser organizational 
ties, the multi-state projects all placed substantial emphasis on recruit- 
ment and socialization of field agents who would be committed to the pro- 
ject's rationale and approach and who could operate effectively without 
close supervision or direct support. 

Despite major differences in structure and dispersion among the 
projects, they shared a number of common features, including: (1) the 
operation of a project office that coordinated the provision of services, 
(2) the development and servicing of a knowledge base composed of R&D 
products and change-process support materials, (3) the development of 
training and technical assistance components to serve the field agents 
and/or school staff; and (4) the conduct of project documentation and 
evaluation activities to provide formative evaluation information to pro- 
ject particpants, to facilitate local self-evaluation by participating 
school sites, and to document project activities and accompjishments. 



2. Program Assumptions 

NIE's assumptions, which were to a large extent reflected in the 
individual projects, involved a set of generic assumptions concerning: 
(1) the conditions believed to control change, (2) the use of appropriate 
tactics and strategies to support school improvement-oriented change, 
(3) the organizational linkages external to the local school necessary 
to provide school improvement services, and (4) the nature of anticipated 
outcomes (Hutchins, 1976). These assumptions were: 

1) Conditions Required for Change 

Certain conditions were hypothesized to be necessary and suffi- 
cient to support change that leads to improvements in educational 
practice. (From- a research perspective, these conditions repre- 
sent the "independent" or "antecedent" variables of the design.) 
They are: 

• Reasons for change . Reasons for change must have been gener- 
ated; whether externally- or internally-generated, these 
reasons |£r change must be internalized within the organiza- 
tion in order for change to occur, and all these reasons must 
be transformed into incentives for the individuals involved. 

• Knowledge on the part of all who must be involved in the 
change . There must be a knowledge of the reasons for change, 
knowledge of alternatives to the status quo, knowledge or 
understanding of the nature of the innovation selected for 
implementation, and reasonable knowledge or expectations 
about the consequences of the change. 

• An innovation . A cleanly-defined, different way of doing 
things must be selected that matches local needs and con- 
straints (the innovation can be generated from within the 
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adopting site or adopted from outside). If actual improve- 
ments are to result from the changes, this innovation must 
have the demonstrated capability of producing the desired 
improvement—increases in .learning. (In the RDU Program, 
this ancillary condition i:s handled either through "front 
end*' quality control --encquragi ng the" selection of R&D out- 
comes with proven effectiveness—or "tail end" provisions for 
site-specific evaluations of the effectiveness of the change 
effort.) 

t An organizational environment that supports the change pro - 
ceTs . The organization must provide leadership and absence 
of threat to those who seek change, and a management , and 
technological capacity equivalent to that required by the 
targeted innovation. (Included in* the Tatter requirement * 
would be an ability to define goals, identify appropriate 
roles and divisions of labor, gather and use appropriate 
feedback about the early use of the innovation, and deliver 
needed support services.) 

t Material resources . Those, if a?iy, required to acquire the 
necessary elements of the innovation. 

t Human resources . In sufficient number, with sufficient 
skills, along with available time and energy to carry out 
the design of the innovation. 

t A plan of and formal commitment to what is to be done . This • 
should be developed by and endorsed by those involved in the 
change. 

« Sufficient time for the change to be implemented and for the 
outcomes to be observed . ~ 

t An opportunity or triggering mechanism . Something must provide 
impetus to put the process in motion. (It could be an event 
such as the failure of a school bond issue, the hiring of f* 
new superintendent, or an event tied to a regular, planned 
renewal process stfch as a scheduled review of materials for 
replacing existing texts.) 

2) Tactics and Strategies for Change Support 

(From a research perspective, these tactics for mitigating un- 
favorable conditions constitute one of two sets of "intervening," 
or manipulated variables.) In the presence of all the condi- 
tions listed above, it was hypothesized that change will occur. 
In the absence of such conditions, it can be said that there 
is a discrepancy fyetween the conditions jcessary for change 
and those that exist. When discrepancies exist, an agent (an 
individual, an organization, a "system" of organizations) can 
Undertake to provide services and/or stimulate internal capac- tf 
i^ies to correct the deficiency. When applied from outside 
the school, these 'services constitute a set of "tactics" or 
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support services. For example, a variety of information tactics 
can be deployed when knowledge is deficient. Training or the 
use of consultants can be arranged when human resources are 
inadequate. Financial resources can be supplied when funds are 
deficient. Innovations can be made available or modified when 
none is available from within. These tactics can, in turn, be 
combined and implemented in a pattern of tactics (i.e., a 
strategy). 

3) Organizational Linkages Necessary to Provide the Required 
Services* * (These constitute the other set of intervening vari- 
ables.) The program hypothesized that when internal capacity 
is insufficient to supply needed services, the involvement of 
one or more external organizations (or individuals) may.be 
required to implement the activities/tactics/strategigs neces- 
sary to mitigate deficient conditions. One agency, such as an 
intermediate service agency, might not have the necessary 
capacity and resources to deliver all the required services. 
Hence, linkages or arrangements among several agencies may be 
needed to provide necessary resources and to implement the 
required tactics. 

4) Program Outcomes 

(These constitute the dependent variables.) 

The outcomes that are predicted when the above necessary and 
sufficient Conditions prevail are as follows: 

• A mitigation or amelioration of unfavorable conditions for 
change, which, in turn, will result in . . . 

•i 

• A change or changes in the educational program (school 
management, classroom instruction, etc.) which, in turn, 
will contribute to ... » 

• Improvement in the performance, achievement, or growth of 
school-age children or adult learners. 

These outcomes define the long-term objectives of the projects. 
It is also possible to identify shorter-term objectives which, 
under certain investigative circumstances, also'constitute 
dependent variables. These are related to the four areas in 
which the RFP called for services: 

• Improved identification of losal need!; 

• Increased sophistication in establishing criteria for 
selection of innovative programs; ^ 

• Increased use of information about R&D-based innovations; and 

• Increased utilization of R&D outcomes. 

P 
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In Summary, the paradign of assumptions of the R&D Utilization Program 
is contained within the following statement: 



Certain conditions are presumed necessary and sufficient 
for change; when one or all are missing or unsatisfactory, 
there are thought to be tactics that can be delivered as 
services to improve conditions for change; the services can 
be obtained from within the organization or through external 
linkages with other organizations. When these services 
Result :n sufficiently improved conditions, change and 
4 improvement "will occur. 

It should be emphasized that this description isNdeal ized. The 
elements described do not necessarily have a one-to-one correspondence 
wtth fhe specific assumptions of the seven field-initiated projects, 
but they do tend to define the common set of program assumptions shared 
by the seven RDU projects. 



3. Study Methodology 

Because evaluation components were specified in the RFP, eagh pro- 
ject completed vari ous self-evaluations cf its 'own activities. Further, 
under the leadership of the NIE and with evaluation technical assistance 
provided by the Far West Laboratory, the seven projects developed a com- 
mon set of documentation instruments and a shared case study methodology 
that were used by the projects to document their own findings and accomp- 
lishments, including the eventual production of 42 case studies. Early 
interim RDU findings across^the seven projects were reported in Blackwell, 
Hood, and Pool (1978) and in Louis, Molitar, Spencer, and Yin (1979). Be- 
ginning in November 1977, Abt Associates, Inc., a social science research 
firm based in Cambridge, Mass., initiated a three-and one-half-year, in- 
depth study of the RDU program that addressed six major issues: 



t how relationships are managed' among various agencies 
which have the expertise and resourcesto help local 
schools solve problems; 

t to what degree an intervention program such as RDU can 
help schools overcome barriers to successful problem 
solving (such as limited access to information or lack 
of planning skil Is); . 



t 



to what degree the products of educational R&D are 
relevant to the problems and contexts of local schools; 



t 



what is the impact of the products of educational R&D 
once they have been adopted and implemented; 



t 



what factors contribute to the institutionalization of 
the RDU approach within a variety of organizations; and 
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t how field agents coordinate the flow of external resources 
to schools, and whether this practice helps schools solve 
problems. 

Early in their study of the RDU program, Abt researchers conduc- 
ted a series of familiarization visits to nine -participating schools. 
Through unstructured interviews, the researchers learned that, in gen- 
eral, awareness and utilization of new educational products were being 
increased through the use of improved problem-solving practices. It was 
also apparent that, as a direct result of participation in the program, 
the schools themselves as well as the school personnel were changing in 
a variety of ways. This early finding led to a decision to expand the • 
range of Outcomes to be studied to include an array of unintended organ- v 
izational and personal impacts going beyond the original NIE and project 
assumptions, ^he methodological "approach employed by the Abt researchers 
mertfed ^qualitative and quantitative data within as well as across sites; 
employed persistant attempts to triangulate data sources and interpreta^ 
tions; and involved cyclical interaction between the qualitative and 
quantitative method during all phases of the study, including sampling, 
instrumentation, data collection, and analysis. 

Data sources included: data collected by each of the seven RDU 
projects, including the 42-site specific and relatively unstandardized 
case studies produced by case study writers employed by the seven RDU 
projects; early cross-site data on sites and^ li nking .agent activity that 
had been organized by the Far West Laboratory ^ajid the NIE; a mailed .sur- 
vey in Fall 1979 with completed returns from 594 teachers (48% response 
rate) and 152 principals (76% response rate) from a sampTe of most of 
the schools that had not officially "dropped out" of theV^gram; and 
field notes and site reports based on visits by Abt researchers to 51^ 
RDU schools (nine were visited during the orientation phase; 42 addi-* 
tional schools were visited in Fall 1978 and Winter 1979, and half of 
the 42 schools were revisited in Fall 19790 In addition to these major 
date sources, there were a variety of other sources, including data on 
the seven projects and on the field agencies and agents that served each 
of the school sites, "event-triggered" reports submitted to the NIE 
describing the different phases of each school site's progress, a case 
study writer's survey (which provided some standardized d3ta on almost 
alJ the case study sites), and various other documents provided by the 
projects, the sites, or other individuals. 

9 



""in five of the projects, questionnaires were sent to the universe of 
principals whose schools had been in the project for at least two years. 
Due to the number of schools involved in the Michigan and Georgia pro- 
jects 'schools were sampled. In the case of teachers, each RDU project 
provided a list of "potential users" : for jsach sampled school. If there 
were fewer than five teachers, all were included in the sample. If there 
were more than five, five teachers were randomly selected. * % 
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The methods used to merge qualitative and quantitative data sources 
are described in Louis, Rosenblum, and toolitar (1981) ana in Louis (1982). * 
They involved a complex process that permitted the Abt research staff, 
as a group, to arrive at a consensus that produced a reliable, holistic, 
cross-site "consolidated coding 1 ' scheme 'integrating features of both the 
qualitative and the quantitative -data available in variable amounts 
across the sites. Consolidated Coding Forms (CCFs) were prepared for 90 
schools. (As many as 179 RDU project schools were represented with 
teacher survey data, but only 55 schools are represented by "principal , 
teacher, and Consolidated Coding Form data sources.) 



4. Key Overall— Program Findings 

• The Abt researchers rewbrked the NIE hypotheses (see Assumptions 
section above) based on additional literature reviews and preliminary 
data collection to produce the schema outlined in Figure 4. 

In terms of the schema depicted in Figure 4, the RDU intervention 
employed three interrelated strategies to produce school improvement out- 
comes. These are (I) provision of R&D-based products , (2) provision of 
external technical assistance ? and (3) stimulation and support for school 
staff to undertake an internal problem-solving process . External technical 
assistance is seen as influencing internal problem solving, which, in turn, 
leads to the selection of appropriate R&D-based products, which are then 
implemented by the local school. Finally, (4) local conditions, including 
site and problem characteristics, are seen as also affecting the problem- 
solving process. JJn four types of variables: (1) products, (2) technical 
assistance, (3) problem-solving process, and (4) local conditions are seen 
as affecting proximate and distal outcomes. We*shall use this schema to 
review some of the key overall findings of the Linking R&D with Schools 
Study.* . 

As in the DESSI study, the Abt researchers also examined outcomes at 
the individual and the school level. 

Individual" outcomes . The data for these findings are based on analysis 
of survey responses from individual teachers and principals, as well as data 
on the 90 CCF sites, that examined four categories of knowledge utilization 
and school improvement: R&D product outcomes, probl em-s?ol ving process out- 
comes, outcomes for the school organization as perceived by individual teach- 
ers, and personal benefits for teachers.* 

ft&D product outcomes . Among'the schools that had reached the "product 
selection" stage by the time of final data collection, more than 80 percent of 
the teachers. responding to the survey indicated that they had used or were 
using the selected products, and another five percent had definite plans to 1 
begin use in the future. Fewer than 20 percent of the users reported that 



*This summary is based primarily on Louis and Rosenblum (April 1981) and 
•Louis, Rosenblum, and Molitar (July 1981a, July 1981b). Note that the . 
Abt study findings are far more extensive than those summarized here. 
Please see Bibliography at the end of this report. 

• . i 

3.34 

0 o 



Figure 4. 



A SCHEMA FOR EXAMINING THE IMPACT OF KNOWLEDGE UTILIZATION ON LOCAL SCHOOLS* 



LOCAL CONDITIONS 



SITE 

CHARACTERISTICS 



PROBLEM 

-CHARACTERISTICS 



(NIE) 
I 
I 

▼ 

INTERVENTION 
(Project Design) 



R&D BASED PRODUCTS 
(Curriculum) 




EXTERNAL TECHNICAL 
ASSISTANCE 




INTERNAL 
PROBLEM-SOLVING 
PROCESS' 



OUTCOMES 



♦Lines and arrows represent hypothesized relationships 
dotted lines and arrows represent hypothesized relationships rt h ioh arc discussed in 
reports of the RDU study (Corwin, 1980? Louis and Rosrnblun, 1981). 
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the products selected needed adaptation to a great or very great extent. 
Product use was high: More than 65 percent of those using the products 
reported they used them with all their students, and 85 percent stated 
the product was regularly used at least once a'week, Satisfaction with 
the adopted products was generally high, with more than half of the users 
reporting that the prbducts were directly relevant to the most pressing 
problems in their schools. Only about nine percent of the users reported 
great or very great difficulties in implementing the program or. materials 
they had selected. Fully 83 percent of the users 'reported they would 
continue to use the materials. In terms of longer term implementation, 
principals in more than 70 percent of the schools said that the products 
had been or would be incorporated into curriculum plans. More than 90 
percent of the principals reported that some or all of their teachers 
would use the products to some extent, and 62 pejcent 'said that the pro- 
ducts would be used extensively. 

Problem-solving process outcomes * The RDU strategy called for broad- 
based participation in a rational problem-sol ving process at each site. 
At 92 percent of the 90 sites for which highly detailed (CCF) data were 
available, problem-sol ving teams were formed, with generally good repre- 
sentation on the teams. From a detailed examination of the extent to * 
whicfi each site followed an "ideal" rational problem-solving process, it 
would appear that most of the sites adhered closely, but not completely, 
to the principles of sound problem solving. 

Outcomes for the school organization as perceived by individual 
teachers . The majority of the teachers—between 50 and 70 percent--re- 
ported .that there were positive effects on their schools on a number of 
dimensions: improved curriculum, better materials available, enhanced 
col legality among staff, better teaching. About 45 percent of the 
teachers said the image of their school in the community had improved, 
and about 40 percent reported an improvement in school organization and 
management,* improved decision-making and probl em-sol vi ng procedures, and 
improved morale. Although about 30 to 50 percent of the teapher%. reported 
"no change" on any one of these dimensions, generally fewer than two per- 
cent said any of these dimensions had been adversely affected. 

Personal benefits for teachers . An anonymous questionnaire' was used 
to ask participating teachers about personal benefits. Between 15 and 
30 percent of the teachers reported that they had benefited "to a great 
extent" or "to a very great extent" in the following ways: Their teach- 
ing and leadership skills had improved; they had learned about curriculum 
development; they had more self-confjdence; and they had new resources 
for helping their colleagues. Another 30 to 40 percent of the teachers 
reported these benefits "to some extent." 

School -level outcomes . The results reviewed in. the previous sections 
were largely based on raw data from individual teachers and individual 
principals as the units of analysis. In the following sections the re- 
sults are presented, with theschool as an organization as the unit of 
analysis.. To reduce the number of variables to a manageable set, summary 
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scales were developed for each school from data in the consolidated coding 
forms (CCF), the survey of principals, and aggregated teacher survey data.* 

Most of the school-level analyses involved correlational md multiple 
regression analyses in which various sets of predictor variables were re- 
gressed on a set of six outcome measures: (l) organizational impacts ^ a 
global measure of impact on the school, i ncluding improvements (as a re- 
sult of RDU participation) in curriculum, materials, school organization, 
staff morale, etc.; (2) product incorporation , a measure of the extent 
to which product use continues after implementation; (3) problem-solving 
process . incorporat ion , such as reported re-use of all or part of the activ- 
ities and procedures which the RDU process involved; (4) problem solved , 
the extent to which principals and teachers reported- the. problem had been 
solved through the use of adopted materials, including improvements in 
pupil performance, attitudes, and behavior; (5) scope of implementation , 
which refered -to the proportion of pupils in the school who are exposed 
to the adopted product and the proportion of their school day affected by 
its use; and (6) persona 1 impacts , a global measure* of personal .impacts, 
including increased knowledge about curriculum development, increased 
self confidence, improved teaching skills, etc.** Examination of the 
table of correlations for these measures indicated that four of them-- 
scope of implementation, problem solved, incorporation of R&D product, 
and organizational impacts—were all moderately highly intercorrelated, 
with correlations rangingfrom .46 to .60. In contrast, the correlations 
involving personal impacts with the other five outcome measures ranged 
from .21 to .49; and those involving process incorporation ranged from 
.21 to .39. Although somewhat correlated, each of the six outcomes repre- 
sented a conceptually different outcome that displayed somewhat different 
patterns of relations to the RDU intervention components and with the 
local site conditions. In terms of the schema depicted in Figure 4, 
here are some study results for school-level outcomes. , 

Outcomes for R&D based products. Approximately 100 (different pro- 
ducts or sets o f curricular materials were adopted by participating schools. 
In general, products ranged from lists of objectives for teachers to de- 
tailed management programs. The products themselves varied along a , number 
of dimensions that were related to various outcomes. 



*Again a reminder that the Abt reports contain much more information 
on school-level outcomes than is summarized here. 

t 

*Two additional /process outcomes were al so, cons idered: (7) site satis- 
faction with the activities of the field agent (to be considered in a 
later section), and (8) site satisfaction with tne problem-solving pro- 
cess. With two exceptions, both involving satisfaction with the field 
agent, all the 28 correlations among these eight tjojtcome measures were 
significant (N = 180 schools), with correlations ranging from .11 to 
.60 and a median correlation of .30, The two satisfaction measures 
were significantly correlated, r = ,42, but the correlations with the 
other six measures ranged from .11 to .27 for satisfaction with the 
field agent and from .27 to .43 for satisfaction with the problem-* 
solving process. « 
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Product qual ity , which reflected the degree to which teachers and 
principals rated* the products as relevant, applicable in their situation, 
and providing a genuinely new way of doing things, was particularly im- 
portant in predicting the degree to which the/ particular local • problem 
was solve d (Beta coefficient, B = .58),* the level of product incorpora - 
tion (B - .24), and p ersonal impac ts (e«9«> staff development benefits) 
reported by teachers ~(B = . 36). * The complexity of the product was im- 
portant in predicting overall organizational impacts (B = .31), product 
incorporation (B = .29)% personal impacts (B = .21), difficulty of i m- 
pl emen tation = .31), and the overall organizati o nal impacts (B = .?8). 
fTuTTTpTe correlations (involving only those product""" characteri stic vari- 
ables that increased the multiple R2 by 1% or more) produced R^ values 
that ranged between .33 and .51 for five of the six outcomes. Only 
process incorporation was not well predicted by product characteristics 
( product val idation was the only characteristic with a significant Beta, 
.35, with this outcome ) . 

The many significant, and moderately sizeable R 2 , values indicated 
that product characteristics were significantly more important than-most 
current implementation theories allow. Good products not only create 
student impacts and organizational change, but" also have significant 
personal impact (e.g., staff development) spinoffs. Local materials 
development and adaptation, rather than facilitating implementation and 
institutionalization (as suggested by the earlier RAND "Change Agent" 
studies) showed slight, but consistently negative, relationships with 
outcomes (e.g., -.27 correlation between new materials cfevelopment and 
scope of implementation' ). Louis and Rosenblum (April 1981, p. 6) drew 
thi s" conclusion: 



*Most of the Abt study findings for school level outcomes were reported 
in terms of standardized stepwise regres;ion (Beta) coefficients with 
predictor variables regressed, wit!, an unforced order of entry, against 
each of the six measures of school outcomes. Beta coefficients are re- 
ported only for those variables that contributed to the multiple corre- 
lation squared (R2) by one percent (1%) or more. To simplify reporting, 
only statistically significant Beta coefficients (B) will be reported here, 
with p < .05, unless otherwise noted. Note also, B is not the unstandard- 
ized regression coefficient. We have used the symbol B, rather than 8, 
for typing convenience. 

•ft » 

**Note that most of the prodOcfrs actually adopted were practitioner-devel- 
oped and validated (i.e., NDN\ products) rather than formally developed R&D- 
based materials such as those found in the NIE Catalogue, Of 194 product 
adoptions reported by Spring 1979, only 19 (10%) were selected from the fil 
Catalogue, whereas 47 (24%) were selected from the NDN Catalogue. A total 
of 74 (38%) products, including locally validated products, were assumed to 
have been validated, whereas 120 (62%) were not known to have been validated. 
The characteristic of the adopted product having been validated (i.e., 
"objective" quality) was a significant predictor only of the proces s incor- 
poration outcome % and a nonsignificant, but incremental, predi ctor af the 
scope of imple mentation. However, "subjective" p roduct quality , as 
perceived by adopters, was a relatively powerful predictor of the three' 
outcomes as noted above. 
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This implies, we believe, based on our site visit 
data, that externally developed products can be 
implemented v*tth only slight tinkering vf the 
school has carefully defined what it is that they 
need, and has gone through-*** systematic process to 
find a product that will not\only fit the problem 
but the local context. It is not necessary to 
recreate the wheel in each district in order to 
obtain high levels of school improvement. 

The impjact of external technical assistance . Two kinds of , external 
technical assistance were provided to schools by most of the projectc: 
the services of a "linking agent," facilitator, or other problem-sol ving 
general ist who was employed by the RDU project to support the school in 
its activities over the entire prob lent- solving process and specialized 
training which was typically intended to aid the school staff in imple- . 
menting the "chosen R&D product. # Eight external technical assistance 
variables were correlated with s*ix school outcome measures for a sample 
of 76 schools. Among the 48 possible Beta coefficients, 13 were statis- 
tically significant (p < .05). These significant relationships indicated 
that technical assistance and training -activities had substantial impacts 
on scope of implementation , organizational change , and product incorpora- 
tion , where multiple correlations explained 46 percent, 40 percent, and 43 
percent of the respective variances. However, three outcomes —problem 
solved (R2 = .21), problem-solving process incorporation (R^ = .21) , and 
personal impacts (R? = .19)--were much less impacted. Three technical 
assistance variables—one, related to training and two related to linking 
agent behavior—appeared to be the most powerful predictors of impacts. 
The amounts of training received by site staff fcrior to implementation ^. 
and after implementation had significant effects on organizational im - 
pacts (B = .33) , degree to .which problem was sol ved (B = .24), Scope "of 
implementatio n (B = .28), and' personal impacts (B = .26). The diversity 
of training sources also had significant impacts on organizational impacts 
(B = .25) /product incorporation (B = .43 )\ problem-solving process- in- 
corporation r (B = .22) r degree to which the problem was solved (B = .31), 
and personal ' impacts (B = .21). The time that the linki ng,agent spent 
with local site committees or problem-solving' teams, linking agent time 
on site , was predictive of the degree of product incorporation (B = ."23J 
and scope of implementation (B = .31). Both th§ quantitative and the 
qualitative data suggested that the two types of external technical as- 
sistance have different impacts on the site. On the one hand, field / 
agents (generalist s) appeared uo have their great§fct impacts in stimu- 
lating the school to define its problems more broadly and to think more , 
ambitiously about wh,:t it might do to solve fhem, thus producing. a change 
program at the site of greater scope with better chances for effective 
product incorporation. The specialized training provjded by consultants, 
on the other hand, had broader impacts within the school, affecting not 
only product incorporation and scope of implementation, but also prob- 
lem-solving p; Dcess incorporation, degree to which the problem is 'solved, 
and groduction of both personal impacts and broader organizational .changes. 

The impact of internal problem-solving activities . The RDU approach 
was unusual among federally sponsored dissemination activities in its ft 
stress on the need to provide*e£ch participating site with assistance in 
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problem solving at each of a series of specified stages, including:* (1). 
identification of a problem or a set of problems ongyhich school staff 
agreed to work; (2) specification of criteria on which staff a^r°^d to 
judge the characteristics of potential solutions; (3) examination of al- 
ternative solutions to the problem, focusing particularly on the products 
of educational R&D or on validated practitioner-developed products; (4) 
selection of a specific solution considered to be appropriate to the *• 
problem; (5) planning for implementation; (6) implementation of the so- 
lution; (7) evaluation of process and outcomes; and (8) incorporation 
of both the solution and the problem-solving process. In addition to 
this rational problem-solving process, broad-based participation among 
those who might be affected by the process was also stressed. All the 
RDU projects attempted, in varying degrees and with different approaches, 
to gi/ide sites through this generic problem-solving approach.* Although 
projects could exert less direct influence or control over this part of 
the RDU intervention strategy (as compared with project influence over 
the R&D-based or validated products that were made available or the type 
of external technical assistance that was provided), the local problem- * 
solving process was considered to be an essential feature of each pro- 
ject 's;ef fort. * 

The Abt data show that among the 90 sites for which highly detailed 
data were available, problem-solving teams., with generally good represen- 
tation, were established at 92 percent of the sites. Interest and attend- 
ance were high in most sites, and few members dropped out. However, the 
Abt researchers found that, during the early stages, decisions were often 
'made or were heavily influenced by administrators or other external par- 
ties.: This effect occurred at 36 percent of sites during problem iden- 
t.fication, and at 24 percent of the sites during solution selection. 
And during later implementation stages, meetings and formal decision 
making were less regular in 20 percent or more of the sites.. The adher- 
ence to the principles of sound decision making was surprisingly high, 
yet far from perfect.. For example, 80 percent of the s.ites carried out 
probl^m-identification-procedures according to plan, and during solution 
seleStion, 80 percent or more of th^ sites selected a new and pertinant 
solution that was acceptable to botff the'staff and the administrators. • 

However, more than percent of thelites showed one* sometimes sev- 
eral , (departures from "ideal 11 problem-solving criteria established bv the, 
Abt researchers. For example, during problem identification, 46 percent 
of the sites provided a problem definition, that wa'lir merely, a restatement 
of someone's prior assumption or pet thcQry-; in 34 percent of the cases 
the problem was not adequately specified before the search for solutions 
was urdertaken; and in 44 percent of the cases,, alternat ive solutions 
were not examined in terms of a set of expl icit> criteria. During imple- 
mentation, adherence to sound p/actice was general]^ much closer, with k 
only ebout a quarter of the sites showing any deviatfojis. Perhaps most 
surprising, the Abt researchers found that 41 percent\of the principals 



*The RDU program was especially remarkable 1n its emphasis <yn the "pre- 
deciiion" stages, 1>e. , problem identification, solution criteria defin- 
ition, solution search, and solution selection. / 
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and 34 percent of the teachers at participating schools said they had re- 
peated or were repeating all or part of the process with another problem 
in thejr school. Frequently repeated parts of the approach Included: 
use of teams of teachers and administrators to make decisions, enlisting 
the services of an external field agent, and using procedures for deciding 
among alternative solutions. 

In the Abt quantitative analysis eight problem-solving process vari- 
ables were measured: (1) level of effort, (2) overall quality of the prob 
lem-solving process, (3) faculty influence on the process, (4) principal 
influence, (5) superintendent influence, (6) other central office staff 
influence, (7) breadth of involvement in solution selection, and (8) 
breadth of involvement in implementation. Among the 48 regression coef- 
ficients involving these eight process predictors and six measures of 
school outcomes were 11 statistically significant coefficients. However, 
the multiple coYrelations were substantially lower than those found using 
R&D product variables or external technical asistance variables as pre- 
dictors. , 

Among the six school outcome measures, only organizational impacts 
(R 2 = .38) was predicted with a multiple above .*0. Much of the pre- 
dictive power of the internal problem-solving process on school outcomes 
resided in the two measures of breadth of involvement (during solution 
selection and during implementation) and in the measure of overall fac - 
ulty influence over the decision-making process. (However, none of the 4 
Beta coefficients for these predictors exceeded .310 

It should be noted that breadth of involvement in implementation* 
reflected not just the involvement of th$ faculty and principal within 
the implementing school, but also the involvement of the superintendent, 
central office staff, and other rel evant/ actors. A high score typically 
represented a district in which the central office staff typically took 
at least some interest in monitoring and supporting the practice and in 
helping to spread the new practice to other schools in the district. 
The involvement of the whole faculty in the problem-solving -process was 
often a key element in expanding the sense of ownership beyond the small 
committee that selected the innovation. 

There were two remarkable "negative" findings: The internal problem- 
-solving process did not predict the level of personal impacts reported 
(R2 = .05) and principal influence was oot.a significant explanatory 
factor for any of the six school outcome measures. The Abt site visit 
data do indicate that, for mar\y of the most successful schools, principals 
facilitated the problem-solving process stages, but preferred to let the 
process be teacher-dominated. Though not totally passive, the principals 
in these schools did not receive the highest scores on influence. This 
strategy worked, however, only when there were active and able faculty. 
It should also be noted that the lack of personal impacts (e.g., on level 
of staff development benefits) represented a measure aggregated at the 
school) level ./Measures of benefits for individual members indicated that 
there were consistently greater personal benefits for those who were on 
the problemrsol ving team when compared to those who were not on the team. 




3.41 - 

9o 



The impact of -local site cftnditions . A relatively large number of 
variables were employed to provide measures in five categories: (1) prin- 
cipal characteristics, (2) teaching staff characteristics, (3) school size, 
structure, and climate measures, (4) characteri §tics' of the community, and 
(5) characteristics of the problem that was* selected. The results of re- 
gressions of outcomes on each of these sets of predictor categories sep- 
arately f\ad little^ explanatory power. For principal characteristics and 
characteristics of the community setting, there were no regressions th?t 
explained as much as 15 percent of the variance in any outcome variable. 
For teacher characteristics, only the percent of staff who were male showed 
a significant, but negative (!) relation to overall organizati onal impacts ♦ * 
Three structure and climate variables did explain 15~percent of the vari- 
ance in overall organizational impacts: teacher change orientation , prin - 
cipal influence over decis i on making , and teacher influence over~~deci sion 
making . Only one ? of the five categories of site variable," characteri s - 
> tics of the problem (principally Miat the problem had a fo'cus on ciass'room 
organization or on pupil performance) explained as many as three of the 
six outcomes (these were organizational impacts , degree to which the prob - 
lem was reported solved , and personal impacts ). However, when eight oT 
the most potent of the 31 site variables were combined, relatively high 
portions of the criterion variance were accounted for, with R2 = .50 for 
product incorporation, ; R2 = .42 for organizational impact , R2 = .40 both 
for problem solved and for scope of implementation ; R<? = .31 for process 
implementation ; .and R2 = .24 for staff development benefits. Among the 
eight selected school-site measures, only school level and index of dis- 
advantagement among -students failed to produce significant regression 
coefficients on any of the six^.school outcome measures. Teacher influ - 
ence in decision making had significant coefficients in the prediction 
of both product incorporation (B = .35) and problem-solving process in- 
corporation (B = .34), and teacher, change orientation had significant 
coefficients in t}ie prediction of overall organizational fmpacts_ (B = .52) 
and degree to which the problem was reported solved (B = .28). The per- 
cent male teachers had a significant negative coefficient for organiza - 
t ional impacts (B "= -.28). 

Prior problem-sol ving activities added one or more percent to the 
multiple R* for five of 4 the six outcomes, but showed statistically sig- 
nificant regression coefficients for only product incorporation (B = .21) 
and process incorporation (B = .29). These particular results suggest 
that rational problem solving may have a cumulative fcffect in terms of 
school outcome impacts. 

The most impressive single school site predictor was thSt the prob - 
lem was concerned with pupi 1 performance . This predictor had statistic- 
ally significant coefficients in five of the six multiple regressions on 
outcomes with the following Betas: organizational impacts , .30; product 
incorporation , .47; process incorporation , -.31; degree to which problem 
was reported solved, .47; and scope of implementation, .40. Finally, 

. * 



*Louis (personal communication) corrected our first impression that 
this negative effect probably confounds sex of teachers with level cf 
school, since most male teachers are" in secondary rather than elementary 
schools. Louis noted that the equation included school level. Moreover, 
a similar finding was reported in the Rural Experimental Schools study 
(Rosenblum and Louis, 1981). 
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the site characteristic that the problem was concerned with classroom or - 
ganizatifcn had significant -Beta coefficients in two regressions: problem 
solved, .27; and scope of implementation, .39. 

The combined impact of the three interventions relative to the impact 
of site characteristics . Table 4 displays squared multiple correlations 
(R2) and adjusted squared multiple correlations for each of the three sets 
of intervention components separately, for the three intervention compon- 
ents combined, for the local site characteristics, and for the combination 
of all four components. Entries in this tsble should be compared by rows, 
across columns. S e ince the adjusted squared multiple correlations reflect 
adjustments for sample size and for the number of predictor variables that 
were included in the particul ar>«regression equation, these' values may be* 
closer 'to the value that might be expected if the same predictors were 
cross-v«l idated on another similar sample of cases. If we compare the ad- 
justed values by rows, we note, for instance, that the ./three separate 
RDU intervention components (Product, representing 11 predictors; External 
Assistance, representing eight , predictors; and Problem-Sol ving Process,^ 
representing eight predictors) each can account for 28 to 36 percent of * 
the variance in predicting organizational impacts; however, when the three 
components are combined (with four predictors selected from each of the 
three components) they can -account for 55 percent of J;he organizational 
impacts variance, and their combined effect is a more powerful predictor 
than the most potent set of eight site characteristic predtctors, which 
can only account for 40 percent of the variance in the organizational im- 
pacts measure. Finally, when strategies and site characteristics are 
combined--15 predictors--an impressive 68 percent of the variance in the 
outcome is predicted! 

With the exception of one school outcome measure—degree to which the 
problem was reported solved--the combination of intervention strategies 
proved a more powerful predictor of^ school outcomes than any one of the in- 
tervention categories. For all six outcomes, the adjusted R2 for the three 
combined intervention strategies equaled or exceeded^the adjusted R2 for 
site characteristics. In other words, the combined' power of the RDU inter- 
vention components equaled or outweighed local site characteristics, in ex- 
plaining the school outcomes. The Abt researchers note: 

We interpret this as implying that the RDU intervention v 
was particularly effective in equal izing the inequalities 
in innovativeness among schools that naturally occur as a 
result of differences inj personnel resources, community 
resources, prior innovative experience. . . . 

Finally, the adjusted R2 values found in the right-hand column indi- * 
cate that when 15 of the most powerful predictors drawn frontal 1 four of 
the predictor variable sets . are combined, explanatory power is increased 
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Table 4 . Percentage of Variance Explained by 
Three Intervention Strategies and 
"School Characteristics. 
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substantially in some cases.* s More than two-thirds of the total variance is 
predicted for organizational impacts . Only the process incorporation re-^ 
mains not well predicted, with only 29 percent of the" variance explained. * 

What did it cost to achieve site outcomes? The financial resources* 
directly available from RDU to local sites* were very limited, ranging from' 
$1,000 to $8,000 per site. However, these resources were only a fraction 
of the actual costs of the innovation process. Based on detailed cost data 
obtained for 22 sites through intensive examination of records, plus inter- 
views with project participants, Abt researchers estimated that RDU funds 
accounted for only 20 percent of the J oca 1 sjte costs of participation 
when i\£-kind costs and when personnel time contributed by school, district* 
or" other sources were included in ,the site's RDU cost estimates. When to- 
tal costs (direct plus in-kind). and the percentage of in-kind costs were 
both correlated with five school outcomes (organizational impacts, incor- 
poration of R&D products, 'incorporation of problem-solving process, degree 
to which problem was reported solved, and personal impacts) for this small 
sample of 22 districts, the results indicate that total costs of the acti- v 
vities at the site level are not significantly correlated (rank order cor- 
relation, rho) with any outcome measure (although the trend indi cates 'that 
the higher the total expenditure the less likely the problem will be re- 
ported solved (rho = -.31) and the less will be the personal impacts (rho = 
-.26). However, the percentage of in-kind costs was a more powerful pre- 
dictor of organization impacts (rho = .49, p = .02 for N = 22), incorpor- 
ation of R&D products (rho = .41, p = .06 for N = 22) and pe rsonal Impacts 
on teachers (rho = .39, p = .08 for N = 21). 

A typology of'outcomes . In the previous sections we have summarized 
the results of a correlational, approach that examined the power of various 
sets of intervention strategy arid school site variables to predict school 



*The 15 predictors included: (1) for product * product quality, difficulty 
of implementation, product complexity, and product validated; (2) for ex- 
ternal assistance , linker/principal contact, linker time on site, amount 
erf training; (3) for Internal P-S Process , degree of faculty involvement, 
breadth of involvement in solution selection, breadth of involvement in 
•implementation; and (4) for school characteristics , teacher 'change orien- 
tation, ^principal influence, problem is in pupil performance, problem is 
in classroom organization, and school index of di sadvantagement. 

**Since we may assume that none of the six school outcome measures was mea- 
sured with perfect reliability, the amount of "'reliable" variance to be 
accounted for is less than 100 percent. For example, if the measure of 
organizational impacts had a true reliability coefficients its re- 
liable variance would be .81. The remaining .19 would be, by definition, 
random or error variance. With an R 2 of .68, the four RDU components ac- 
counted for'. 68 of this .81, i.e., for 84 percent of the reliable variance 
in this outcome measure. "However, consider one other note of cautton. 
The regression results reported in the last column of Table 4 used 15 
potential predictor variables with entry stopped when additional variables . 
added less than one percent to R 2 . With an N of only 49 cases, cross 
validation results may be much less stable and probably smaller than the 
adjusted R 2 indicates. ' This caution also applies to DESSI (Section III.B.4). 
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level outcomes. The Abt researchers also undertook a second approach that 
led to the typing of sites on the basis of similarities and differences 
among sites in tends of four measures of RDU impact: (1) incorporation of 
R&D products; (2> incorporator? of the problem-sol ving process, (3) impacts 
on the school as an organization; and (4) personal impacts on the staff. 
Sites were asigned to categories on the basis of whether they were "high," 
"moderate-to- low " or "low" on these four impact measures. -The resulting 
categories were: 

# Large-scale RDU success chracterized sites that generally followed 
the RDU model for problem solving with a great deal of fidelity, 
implemented an R&D product frqn their project's knowledge base, and 
showed unmistakable signs of incorporation of both the product and » 
the problem-solving process, along with such spinoff effects as 

c personal impacts on participating staff and impacts on the school 
as an organization; (34% of the sample) 

§ Mixecfrhigh success sites were those that had two high ratings, one 
being a program goal (either product pr process incorporation) and 
the other a spinoff outcome; (17% of the sample) 

§4' RDU success characterized those schools that had one or two high 
scores on program goals but none on the two spin-off effects mea- 
sures; (16% of the sample) 

- a 4 

• Spinoffs were those sites that showed some positive effects on the 
school as an organization and/or personal impacts on participating 
staff, but did not adhere closely to the problem-.sol ving or pro- 
duct adoption goals of the program to any great extent. Note that, 
in many cases, schools in this-category had their own agendas to 
begin with--e.g., developing curriculum' guidel ines--and used the 
resources of the RDU program to achieve them; (10% of the sample) 

Moderate to low success characterized those schools th«at had mod- 
erate to low ratings on three or four outcome areas and no Kigh 
ratings at all; (10% of the sample) 

Failure characterized those "school s that were very poor achievers 
on two or more outcome dimensions and that had no high ratings; 
(13% of the sample). 

These overall findings of the Linking R&D with Schools study were 
succinctly summarized in Louis, Rosenblum, and'Molitar (1981, pp. 39-40; 
th4s is ED 207 258) as follows:* " 



^Additional Abt study data on field agent roles in their organizational 

context (Louis, Keli, and others, 1981) and on the training and support 

of linking agents (Spencer, Louis, and others, 1980) will be presented in 
Chapter IV. . 



3.46 



Dissemination programs create two types of outcomes at the school 
level:' knowledge utilization/implementation and school improvement/ 
capacity building; . 

Engaging in a broad knowledge utilization activity is one of tfie 
most effective means ot building capacity; 

Good products produce good school outcomes: quality control is*a 
critical element of an effective dissemination strategy; 

• 

External technical a^sistance ,is important to facilitate both know^ 
ledge utilization and school improvement. On the whole, training 
provided by experts and gfogram developers that related directly 
to knowledge utilization objectives was more important than gener-^ 
alist field agent support in producing both knowledge utilization 
and capacity building improvements; * 

Field agents (general ists) gere important in facilitating improve- 
ments in problem-solving behaviors at the school level and in in- 
creasing the level of effort and scope of knowledge utilization. 
However, a high level of involvement by-such a'gents may diminish 
capacity-building outcomes; 

The quality of the problem-solving process is less important in 
producing knowledge utilization outcomes than has often been 
thought* However, it is a key *to other^school improvement out- 
comes; - 

School characteristics such as the staff's orientation to change 
and the amount' of principal^ influence are important determinants 
of how well schools will implement a problem-solving process, but 
they do not overwhelm the impact of the intervention; 

The biggest paybff in terms of both knowledge utilization and school 
improvement will be realized by emphasizing the resolution of prob- 
lems that affect the core activities of the school: teaching and 

pupils; N 

* \ 

Costly planned change efforts are no mpre likely to have significant 
impacts on the school than less expensive ones. However, it is im- 
portant to allocate a large proportion of the available resources 
to pay for staff involvement in selecting a solution and planning % 
for implementation. It is also important to supplement external 
funding with intornally contributed staff time and other resources; 
and 

Though not. all schools followed program specifications for a rational 
problem-sol virig process and the implementation of an R&D-based, val- 
idated ■'product, 11 the program intervention had almost no significant 
negative impacts on schools that might offset the generally positive 
findings presented above. ' 
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D, The Research for Better Schools Local- School Improvement Study 

U Program Description ^ 

In 1978 the Field Studies Component of Research for Better Schools 
(RBS) initiated a three-year study of tKe provision of external assistance 

for. school improvement provided by three other, units at RBS, 

* • * 

2. Program Assumptions 

Three RBS program components had developed similar ^curriculum planning 
approaches in three-areas: basic skills,, career preparation, and'cit s izenship 
education. These approaches assumed that the use of specific curriculum . 4 
p.lanniQg"cmd problem-solving procedures and materials by linking agents 
could help schools to identify and correct weaknesses in their instructional' 
programs. Each approach employed similar steps: (1) identification of an 
initial direction through goal setting or through selecting Variables: that 
have a critical impact on the content area, (2) collecting data on performance 
relevant to the selected goals "or variables* (*3) data analysis, and (4) 
innovation design. The three units varied somewhat 1n the exterit to which 
these steps were formally codified. 

Additional assumptions made by the RBS units included: (1) that the re- 
search base in the content field (tfasic skills, career preparation, citizenship 
education) could be applied to Improve instruction,* (2) that change could be 
produced through the use of rational problem-solving strategies "that emphasized 
development of clear goals and making decisions based on adequate information, 
(3) that linkers who employed both a problem-solving "process helper" and a 
technology of instruction approach in specific content areas would be more 
effective than if either approach were used*exclusively , (4) that successful 
change efforts require a local sensfe of project ownership, and (5) that change 
at the local site is best accomplished if linkers work with a Local Planning 
Team (LPT), consisting of several teachers, the school principal, and sometimes 
other key participants that would assume the responsibility for following the 
steps of the approach and for making decisions in the local change effort. 
These assumptions are not very different from those of the RDU Program.** 



* In career and citizenship education, RBS derived knowledge about good 
practice' from descriptions of programs developed by schools throughout < 
the country. In basic skills the knowledge base consisted largely of 
research on student time-on-task in relation to-achievement in reading 
and what experience suggested could affect time-on-task. 

** The reader may recall that RBS was one of the agencies 1n the * 
Pennsylvania School Improvement Program, one of the NIE-sponsored RDU 
projects. Since RBS participation in the Pennsylvania RDU took place 

ci rca 1976-JLiLZ9^^ 

RBS Local School Improvement Study design. However, RBS had been engaged 
in many other school improvement and instructional planning and management 
R&D efforts dating back to the late 1960s. 'Hence, earlier RBS experience 
also undoubtedly influenced the Pennsylvania RDU design. 
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A final- assumption, again like RDU, was that the approaches them-, 
selves should be subject to development and evaluation. As the research 
progressed it became apparent that the RBS approach made considerable 
demands on school resources (e.g., planning time, staff expertise, 
clerical services). m „ 

*3. Study Methodology ' x * * " 

The three RBS units sought volunteer schools to work" with them in 
developing their approaches.- After^negotiations with several districts, 
11 teams were forjned in 13 schools (one team included three schools). 
There was substantial diversity among the selected schools, Four were . _ 
elementary schools, six were junior high schools, and three were high 
schools^ Enrollments ranged from 375 tp over 3,000. Two schools were 
in major cities, three were in suburbs, four were in small cities, and 
four were t in rural areas. Many of the selected schools had substantial 
educatipnal problems (e.g., principals in five schbols estimated that 60 
percent or more of their students were at least a year behind in reading 
and math). 

The Local School Improvement Study was. ba§ed primarily on intensive 
field work in five schools with more limited data collection-in the .other 
eight schools thafhad agreed to work with RBS field agents. Six agents 
worked in five schools. Each agent had an advanced degree in- education, 
teaching experience in public schools, and previous involvement *in imple- 
menting curriculum programs in the field. ^During the school year, the 
f$S field agents averaged more than two visits a month to their schools, 
and, in addition -numerous phone calls were made between'RBS and the sites. 
Finally, there were sun.mer project-related workshops at three of the 
sites. Data were collegted through extensive observation and interviewing 
of field agents and school staff. For more than'two years, RBS Field 
Studies research staff accompanied agents on their visits to sites. Durin 
these visits the observations and comments of participants were recorded 
in. field notes. In addition, there were periodic formal and informal 
interviews as well as observation in schools when the field agents were 
not present. The extensive set of field notes were analyzed to identify 
"and code ^variables of interest. 



4. Key Overall Findings* 

1. The linkers' contribution to the school change process was modest . 
The study did not identify linker activities that uniformly promoted 
educational change. • Indeed/ successful field agpnt behavior in one site 
was not necessarily appropriate for another site. Linkers seemed to react 
to events as much as they provided direction. These adjustments in the 



*Based*on Firestone and Corbett (1981), and Corbett (*1981). Additional 
Information, especially concerning the organization of the schools and the 
RBS^reTattonship,, is available- in-F-irest-one-and Cor-bett-(15Z9-),~ Firestone- 
and Herriott (1980), and Corbett, Davison, and Firestone (1982). The last 
document was not available at the time this review was prepared. 

■J 



ways linkers actually provided assistance were often necessitated by the 
characteristics of the schools 1 -contexts, especially the availability of 
resources, the frequency of administrative turnover, and .the extent of 
school staff conflict. Linkers were helpful precisely because they 
could adjust and thereby act as rfiediators between RBS and the school site. 
This skill in keeping the two agencies working together constructively 
and linkers 1 skills in mediating differences among individuals or groups 
within the school site were perhaps their most useful roles. , 

2. * School factors had a substantial Impact on the change process . 
The support of district staff and the belief of tearm-members that their 
efforts would help solve a locally recognized problem were the major 
facilitators of change. Change was implemented most widely in schools 
where administrators offered early, enthusiastic endorsements for the 
change projects,' followed by their active support and involvement throughout 
subsequent change activities. The relationships between degree of central 
office support and progress through the RBS component's steps, and the 
relation between central office support and the local team's sense of 
ownership were both strong and positive. However/ some kinds of school 
organizational structures were amenable to one kind' of change but not * 
another. For example, loose organizational structuring facilitated 
individual changes but constrained the extent to which sehoolwide changes 
were 'possibl e. School staff relationships and motivation were also 
important. School staff sometimes disagreed about the natiure of the 
problem or the appropriate means for* solving the problem. Moreover, 
school staff frequently reinterpreted and evaluated the usefulness* of 
technical knowledge provided. by field agents, the* resource materials, and 
the °data gathering activities in the light of their personal experience. 
The levels of problem-solving motivation of principals and teachers were 
not always the same. In four teams where the principal's and teachers 1 
motivations differed, "the team's sense of ownership was low and the 
teams made either poor or only fair progress through the RBS steps. The 
relation between level of teacher problem-solving motivation and the 
team's progress through the RBS components steps, and between teacher 
motivation and the team's sense of ownership, were both positive and 
substantial. Overall, the relationship between the principal's motivation 
and progress or sense of ownership and progress were much weaker than for 
teachers. 

c 

School impacts on Unking agent roles .* RBS assigned three technical 
functions to the field agents : (1) to assist program Improvement by 
bringing to the schools knowledge about successful educational practices 
and the process of change through goal* identification and rational problem- 
solving, (2) to help local staff develop the capability to direct the 
change process themselves, and (3) to provide feedback to RBS's development 
specialists on needed revisions in the process. Agents at all sites 
performed these three technical functions. .However, the agents found it 
necessary to supplement their technical role with several additional 
functions in order to keep the schools moving through* the change process. 
Corbett (1981) identified five additional functions: (4) 'expanding 



* Based entirely on Corbett (1981). See Corbett;, Dawson and Firestone 
(1982) for an extensive discussion of this topic. 
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process helping, (5) process adjusting, (6) endorsement seeking, (7) 
mediating, and (8) providing clerical services. 

Expanding proces s -helping . Originally, the RBS agents anticipated 
that thfcy would need ^ provide special technical assistance to a few 
individuals to enable these individuals to guide the change process 
themselves. The agents • expected to model certain techniques for guiding 
the process but expected school staff gradually to assume responsibility 
for planning team sessions and delivering most of the technical knowledge 
teethe rest of the participants. Thus, the'agents hoped to reduce their 
active Involvement over t4me. Generally, this did not happen. 'School 
staff had their normal responsibilities and only limited time to spend 
on the pro'ject. Most RBS agents were forced to assume "director" or 
"coordinator" roles in order to maintain project progress. Only at one 
site did a successful transfer of project leadership to site staff occur. » 

Process adjusting . RBS considered its approach to curriculum change 
to be in a developmental stage; consequently agents were expected to 
provide feedback that woul-d 'assist RBS developers 1n refining the approaches. 
At the same time, agents made subtle on-the-spot adjustments in the approach 
t at individual sites. Typically, agents were required to compromise some 
-tffrchnical aspect of the RBS approach 1n return for continued school 
participation. 

Endorsement-seeking . RBS agents not only needed to obtain the approval^ 
of • school district and building administrators when they began the project, 1 
but found themselves having to re-enter negotiations periodically, primarily 
due to turnover of personnel 1n key administrative positions. 

Mediating . At several sites, the agent would.be forced to intervene 
between teachers and administrators or .risk the loss of the project. 
Agents .often found themselves serving as neutral parties, receiving 
complaints about school practices and serving as spokespersons to mediate 
disagreements. 

Providing clerical services. In order to avoid delays 1n moving to 
subsequent planning steps, and to accomplish the sometimes heavy load 
of clerical work associated with the RBS planning process, agents sometimes 
obtained or provided clerical services for the> planning team. 

Although the RBS approach had defined the expectations for the age/it 
technical functions, four aspects of the school context were the primary 
factors that affected these additional agent roles: (a) school resources, 
(b) interpersonal relations, (c) organizational stability, and (d) school 
staff expectations. 

Resources , The RBS approach required time of administrators to plan 
and participate in meetings, time of teachers to attend meetings and carry 
out projects, expertise of individuals to guide the* team through the 
planning process, and clerical assistance to. compete projects and prepare 
reports. Scarcity of "any of these resources could hinder or delay the 
planning process. To cope with resource scarcity, agents had to expand 
their process helping role, had to adjust the planning process to fit 
local conditions, and sometimes had to provide clerical assistance. * 
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Interpersonal tensions . Because the RBS local planning team included 
both teachers and administrators, interpersdnal relations between school 
units or between administrators and teachers sometimes became a maj.or 
problem that required agents to pUy a mediating role^f^ 

Organizational instability . Severe student discipline problems, last- 
minute meetings, and unannounced visits by parents, also forced agents to ^ 
expand their process helping roles, since administrators were frequently 
pulled away from. planning meetings, fhe agents discovered that they could 
not rely on administrators fc>r directing project activities.' Turnover in 
administrative peVsonnel also mean£ that agents periodically had to seek 
renewed endorsement for the project. 

* 

Staff expectations . Once the agent responded to any of these conditions 
(resource scarcity, interpersonal tensions, organizational instability) by ^ 
performing any of the additional functions (e.g., expanding process helping, 
process adjusting, mediating, providing clerical services), site staff 
usually "expected the agent to retain that function as a regular part of 
the interaction with the site team. In general, school staff pressed . 
/or agents to remain active participants who could perform a wide variety 
of roles that not. only provided technical expertise but compensated for 
problems due to resource scarcity ,. interpersonal tensions, and organizational, 
instability. 



E. The RBS Study of Regional Educational Service Agencies - 

In 1980 s and 1981 the RBS researchers considerably expanded 
the scope of their study of linking agents to examine the school Improvement 
roles played by educational service agencies in New Jersey and Pennsylvania. 



1. Program Description 

In December 1979, RBS began a study of three educational service 
agency (ESA) systems in Pennsylvania and New Jersey. The systems were: 

• The 29 Intermediate Units (IUs) of Pennsylvania. These 
intermediate units provide special education, Inservice 
training, curriculum development assistance, and a 
variety of managerial services to schools. 

v, 

• The 21 County Offices (COs) of New Jersey. These agencies monitor 
compliance with state education regulations and provide assistance 
concerning legal and administrative matters. 

• The four Educational Improvement Centers (EICs) of New Jersey. The 
EICs provide a variety of training and technical assistance services 
primarily In curriculum and instructional areas. 



2. Program Assumptions _ 

Because this was a study of field agents in agencies rather than in 
' programs , we must look at state policies. The state of New Jersey has 
been explicit In separating monitoring from other assistance tasks. 
After a series of judicial decisions in 1975 the New Jersey legislature 
enacted legislation that ma|e the state department responsible for ensuring 
that each school system provide a Thorough and. Efficient (T&E) Education 
to every child in the district. The New Jersey T&E legislation requires 
that school districts follow a state mandated planning process and that 
schools achieve above minimum criterion levels on a state-designed basic 
skills test. Should districts not meet these requirements, the state 
can take over operation of the district. State department planners saw 
two functions to be performed in the field: (1) monitoring to insure 
compliance and (2) training to increase the districts 1 capacity to educate, 
especially in those areas specified by the T&E law* The decision was 
made to separate these two functions. Monitoring procedures were to be 
^developed by the department, and the New Jersey County * Off ice^ were 
assigned the task of implementing these monitoring procedures. The, 
. -training function was assigned to the New Jersey EICs. 

The average New Jersey Couity Office has seven professionals, six of 
whom work in the field by visiting schools to monitor compliance, respond 
to requests for information, and oversee state career education, vocational 
education, and special education programs. (The RBS stucty included data 
on 56 field agents located in 10 of the 21 New Jersey County Offices..) 

P 

The four New Jersey Education Improvement Centers (EICs) were formed 
between 1967 and 1975 to specialize in providing technical assistance t.o 
-schools. Their m'issidn is to "on request » . % provide support and 
assistance to local school districts and to members of teaching and 
administrative staff through the deliver*' of materials, techniques, and 
expertise necessary to improve school programs and services." EIC staff % 
size flucu^es because these agencies rely heavily on competitive federal 
and state funding. In 1980, the average EIC*had approximately 60 staff, 
half of wlvom performed field agent roles by offering workshops, providing 
technical assistance, and operating small resource centers/libraries. 
(The R&S study included* data on 22 field age/its located in two of the 
four New Jersey EICs.) 

V 

Pennsylvania's 29' Intermediate Units (lUs) were formed in 1970 when . 
the state's county offices were reorganized after a major program of 
school district consolidation. Although more than 80 percent of IU budgets 
in the 1970s were allocated to the operation of special education programs, 
the IUs provide a number of other services required by the state fe.g., 
curriculum development and planning services, inservlce education for 
, teacher certification) and they may offer any other services agreed to 
by a majority of the school boards in the region served. The average 
IU has a staff of more than 200 persons, most providing special education 
services; however, most 'IUs have from one to twelve persons who provide , 
inservice traini-ng programs, operate continuing education programs, 
serve as consultants jn curriculum devel opment,* and coordinate contacts 
betwe^g school districts.. in the region and various state and federal 
agencies.- Because the IUs administer special education funds, they do 
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have some monitoring responsibilities in this area, but the IUs are 
primarily service-oriented agencies? that are closer to the New Jersey 
EICs than the New Jersey County Offices in their orientation* Most of 
the program of each IU is determined by a board of directors elected 
from the boards of education of member districts. (The RBS stifdy includes 
data on 60 field agents located in 11 intermediate units.) 



3. Study Methodology 

The RBS study of ESAs was designed to provide information on the 
operation of intermediate level agencies operating in the RBS service 
region. The study was designed to answer questions such as: How are 
ESAs organized to help schools use knowledge? What ar£ the activities 
of the field staff of these agencies? How do field agent activities 
contribute to local school knowledge use? How do schools view and use 
the services of ESAs? How does the environment of ESAs affect their 
operations? 

Data were collected in two waves. In the fall of 1980, site visits 
were made to 23 ESAs (11 IUs in Pennsylvania, 2 EICs and 10 COs in New 
Jersey). Interviews and questionnaires were administered to 138 field 
agents (all the field agents in 17 of the ESAs, and more than* half 
the agents in 6 ESAs). Interviews were, also conducted with 41 ESA 
administrators and with 36 external informants (e.g., superintendents 
of schools, ESA board members). 

In the spring of 1981, site visits were made to 72 school districts. 
In each district the person most familiar with the district's working 
relationship was Interviewed. Questionnaire data (N=537) were also 
obtained from teachers, principals, and central office administrators. 

Three sets of analyses were planned: (1) an analysis of ESA field 
agents, (2) an examination of LEA use of knowledge and services, and (3) 
an examination of ESA operations and interactions with its environment. 
The following findings are based on RBS analyses of field agent data com-, 
pleted in 1981 and 1982 (Firestone and Wilson, 1981a; 1981b; 1982a, 1982b). 



4. Key Fin dings 
* ■ & # 

Perhaps the primary contribution of the RBS study of Pennsylvania and 
New Jersey ESAs is the contrast it provides between assistance and enforce- 
ment roles played by ESA field agents. Unlike the other studies considered 
in-this synthesis, i.e., the State Capacity Bull ding Grants Program, the 
National Diffusion Network, ESEA Title IV-CT, The Research and Development 
Utlllzatlonal Program or RBS's own Local School Improvement Study — the 
RBS ESA study provides a view of another type of change strategy; namely, 
enforcement of federal and state education laws and regulations. Among 
tfhe 133 ESA field agents who provided sufficient data to be included 1n 
the analysis, 43 percent, including virtually all the 56 agents from- the 
'ten New Jersey County Offices, mentioned monitoring as an important part 
of their work.' The survey administered to the field staff included. a 
question asking to what extent each agent played 11 different roles. One 
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role item, "Monitor who identifies discrepancies between regulations and 
practices/ prcved to be unrelated to the other ten items (forming its own 
single item factor in a factor analysis) but was highly discriminating in 
terms of the type of ESA the^field agent was associated with. Firestone 
and Wilson (1982a, p. 33) present data which show that when the individual 
scores for this item were aggregated to obtain a mean agency score ranging 
from 0 to 4 (0*= "not at all" to 4 = "a very great extent"), allien of 
the New Jersey County Offices means were between 3 and 4, as were two of 
4 the 11 Pennsylvania Intermediate Units. However, all the remaining ESA 
means (including the two New Jersey EICs and nine of the 11 Pennsylvania 
Intermediate -Units) were between 0 and 2. With the exception of two 
Pennsylvania Intermediate Units, it appears that the three types of ESA 
could be classified on the basis of this one "monitoring" item as belonging 
to one of two types of agencies: (a) regulatory agencies or (b) npn-regu- 
latory service agencies. Firestone and Wilson, January 1982, p. 33 
present only a scattegram of agency means; however, Firestone and Wilson, 
June 1982, p. 27 report the means by agencies! On the five-point scale 
(0 = not at all; 4 = a very great extent) the mean for 22 agents in two 
New Jersey EICs is 0.67. The mean for 60 agents in 11 Pennsylvania 
Intermediate Units is 1.52. However, the mean for 56 agents in ten New 
Jersey County Offices is 3.61. The F-test for an analysis or variance 
test of the differences among these means is highly significant (P < .001). 

The second most powerful discrimination among types of ESAs was made 
on the basis of a "scale" consisting of two field agent role items: 

t "Expert on a curriculum area" 
t "Workshop presenter" [trainer] 

Perhaps not surprising is the finding that means on this two item 
"Expert/Trainer" scale were exactly the reverse order of those for 
monitoring. Here EICs score the highest (2.90), the IUs are intermefffate 
(2.41) and the County Offices are lowest (2.04). Again, there is a 
statistically significant difference among means (P < .01).. In terms of 
individual agency means for this "Expert/Trainer" scale, only two of the 11 
IUs appear to have means that are (only slightly) higher than the two EICs. 
The two EICs are conspicuous at the high end of this scale. Moreover, 
there is only a small overlap between the distributions of scores of the 
Pennsylvania Intermediate Units and the New Jersey ^County Offices. Only 
two County Offices means are higher than the median for the 23 ESAs, whereas 
only two Intermediate Units are below the median.' Hence, the RBS study 
indicates that the type of ESA agency can powerfully affect some of the 
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roles played by field agents^ specifically their monitoring roles and their 
training role,* 



A factor analysis Of the 11 role descriptor items (an orthogonol 
principal axis factor analysis withvarimax rotation) is reported with 
three factors (see Table 5), The set of items is too small to provide 
reliable scales for three factors, especially the last,** However, the 
RBS in-depth interviews are used to provide greater depth of interpretation 
to each of the three factor scales* * 



Table 5 . 

Factor Analysis of Eleven Field Agent Roles ( N = 138) 



ROLE ITEMS 


FACTOR 1 
Expert/Trainer 


FACTOR 2 
Liai son- 


FACTOR 3 
Monitor 


h2 


Curriculum Expfert • 
Curriculum Designer 
Workshop Presenter 
Group Process Trainer 


.78 
.64 
.62 ■ 
.50 


.15 
.28 
.10 
.35 


-.05 
.30 
. .43 
.14 


.63 

.58 
.58 
.39 


Resource Finder - 
Needs assessor/Planner 
Coordinator , 


.08 
.15 
.21 


-.65 

.59 / 
.54/ 


.08 

->v .15 
\ -.14 


.44 
.39 
.36 


• 

Monitor 


-.09 






.45 


On-Call Consultant - 
Proposal Writer 
Salesperson 


.22 
,41 
.32 


/ .40 

/ - 19 
/ .21 


!l4 


v .23 


Eigenvalue 

Percent Common Variance 


2.05 
44% 


V 1.54 
V 33% 


1.04 
22% 





*It should be also noted that no statistically significant difference 
was found among types of agencies on a third scale consisting of three 
"liaison" i terns • 

** Four items display loadings of ,5 or higher on the first factor. Three 
items display loadings of ,5 or higher on a second factor. The remaining 
four items apparently each formed their own factor* However, for some 
unexplained reason, factoring was stopped and rotated after three factors 
had been extracted, thus producing a third factor with appreciable loading 
on only one item, "monitoring." 
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The first factor is Expert /Trainer . It'cdnsists of four items. 
However, because two of these items, curriculum designer and group process 
trainer, were the least frequently mentioned of the 11 items, the 
Expert/Trainer scale used in subsequent analyses was the sum of responses 
to only two of the four items with high l&adings *on this factor: 

* t "Expert on a curriculum are§" 

t "Workshop presenter" * * 

* Firestone and Wilson (June, 1982, pp. 10-14) quote from two 
interviews with persons who scored h.igh on this dimension of their work: 

I am a specialist in bilingual education and English 
as a Second Language ... I work with or assist any 
district, community agency or college. The range is 
from early childhood education to universities. . . . 
I use two main strategies: workshops that are held at 
the (agency) or In the district or community and 
consultations [at] the agency or on site. . [EIC agent] 

I assist the local education agencies in any area of 
reading from preschool to adult. I meet with core 
committees on Title LV-C projects, help in 
implementation of the Pennsylvania Comprehensive 
Reading Program. ... I do inservice, consulting, 
grant proposals, workshops, and testing. [IU agent] 

•v* 

The second factor, labeled Liaison , includes three items: j 

t Resource finder 

t Needs assessor/planner 

t Coordinator 

The interviews with persons scoring high on these three items suggest 
that liaison work includes both technical and political linkage. Some of 
this liaison activity is for the purpose of determining needs. 

r have three [advisory committees]. One is related 
to bilingual and English as a Second Language.^ The 
other one's related to career education and the other 
one is related to science education. And those are 
forums for . . . creating demands for services. And 
that's a two-way street. Hearing needs and addressing 
those needs with the services we provide. ... You 
have to be a better listener. You have to prod people 
to share with each other. [IU agent] 

Another aspect of liaison is arranging for services: 

^y major responsibility is . . . trying to match 
the need identified in local school districts with 
expertise in our own agency or a local university. 
I coordinate a continuing education program similar 
to that of a college. [IU agent] 
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In addition to arranging for services, liaison agents also mediate 
between districts and regulatory agencies, as indicated in these two 
interview excerpts: 

I inform the board and the superintendents of 
forthcoming legislation'and its effects on their 
policies and programs. Also I get an audience for 
a particular superintendent or .board president c with 
legislators regarding unique district problems. [IU agent] 

We stand between state policies and interpret them. We 
have to soften these policies and assist the districts. 
Sometimes this involves handholding. [IU agent] 

The final faptor,. unfortunately, is represented by only one item: 

Monitor who identifies discrepancies between regulations 
' and practices. " 

Fortunately, the RBS interview data on persons'who rated tjris item 
as one done to a very great extent provided further information on this 
role. The interviews indicated that monitors found that enforcing the laws 
and regulations required a good deal of negotiating and explaining. In 
some cases, this required giving very specific direction: 

«? 

[Regarding] coordinating basic skills and special 
service programs. The Individual [in the district] 
assumed the coordinator's role for special services, 
but didn't work at doing it. . . . We finally said, * 
you must have -a coordinator or the program wqn't be , 
. funded. They got a new coordinator. [CO agent] 

However, monitors often four\d strict enforcement was not possible: 

* You can't hold it over their heads. You can't say "It's 
the law." We show them alternative ways to do things. 

[CO agept] 

In many cases, monitors, deemphasized enforcement and portrayed. themselves 
as working with school districts to help them^cope with regulations: 

I try to help districts be in compliance with federal 
and state mandates. I assist school districts in 
identifying their roles to organize and be able 
to see where they are in the T$E process. [CO Agent] 

Comparison of the three roles . To further explore the functions 
associated with each role type, RBS researchers conducted an indepth 
examination of their data and identified six key facets of field agent 
work where differences were likely to occur amomg the three role types. 
Thirty-two indicatorsr^yere developed, based on both the survey and the 
interview data. The six facets were: 
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1/ the content areas 1n which field agents worked, 



2. the specific activities they, carried out, 

3. the intensity of their relationship with their clients, 

4. the initiators of ESA activities for school districts, 

5. the sources of knowledge agents used, and 

j / 
6: the strategies agents employed to deliver services. 

0 

Table 6 shows the results for the 12 variables where statistical 
differences (based on Analysis of Variance or Chi Separate tests) exist 
among the groups of individuals who scored high (top third of the score 
distribution) on only one of the roles and low (bottom two thirds of the 
distribution) on the other two. These individuals were considered to be 
representatives of "pure-types" "of each of the three field agent roles. 

> 

Content . With respect to the content area facet, the three "pure- types" 
displayed quite different patterns. Curriculum content Was, primarily the 
province of Expert/Trainer agents and administrative content was the 
special concern of Liaison agents. Although legal Content was mentioned 
by. more than 60 percent of a]J_ 133 agents [see Overall Score column], it 
was mentioned by only 29 percent of the 17 "pure" Expert/Trainers. 

' Activities . Almost two-thirds of all agents mentioned conducting 
workshops as one of their work activities. However, ;jthe three pure types 
displayed a roughly evenly-spaced descendi ng^order of mention, Expert/Trainers 
mentioning workshops most frequently (88%), then Liaison Agents (69%), 
and finally Monitors (44%). Roughly the same pattern, but with a greater 
discrepancy between types, was found for writi ng activities: Expert/Trainer 
(76%), Liaison (31%) and Monitors (0% !). Perhaps the greatest surprise 
was that only 81 percent of the "pure" Monitors mentioned monitoring as a 
work activity! The other small ^surprise here was that, pure Liaison agents 
mentioned^monitoring less frequently (8%) than pure Expert/Trainers (24%). 

Intensity . Only one item showed a significant difference on this 
facet. Monitors engaged in far fewer long-term projects (2.3 per year) 
than either Expert/Trainers (10.7 per year)- or Liaison agents (9.2). 

Initiatio n. In the questionnaire, field agents were asked who 
initiatied the~inter action: the district, the ESA, or the state? It 
appeared that, overall, more-than half the initiation was by the districts. 
The state initiated more ESA activity for Monitors (located primarily in 
New Jersey County offices) whereas the ESA itself was more frequently the 
initiator for Liaison agents or Expert/Trainer agents, who are typically 
located in EICs or IUs. 



* A personal sources factor scale, containing three items identifying types 
of persons as sources of knowledge, did not show statistically significant 
differences among the three pure types of agents and thus is not included 
in the table. ~ 
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Table 6 

Selected Differences Among Pure-Type Field Agent Roles 



CHARACTERISTIC 


OVERALL 


PURE-TYPE SCORES 




SCORE* 












expert/ 










1 ra 1 ner 


L 1 a 1 SOfl 


Ma n i trk** 

non i tor 


• 


(N = 133} 


(N =' 17) . 


(N = 13) 


(N = 19) 


Content Areas {% who mention): 










a. Curriculum 


57 


76 


38 


31 


d. Mami n i s ira 1 1 orr 




29 


77 




c. Legal 


61 


29 


77 


88 


Activities {% who mention): 










d. Conducting Workshops 


66 


88 


69 


44 


e. Writing 


32 


76 


'31 


0 


f. Monitoring 


43 


' 24 


8 


. 81 


Intensity (# per year) 










g* Number of Long-Term 






• 


2.3 


Projects 


6.7 


10.7 


9.2 


Initiation {% of time initiated by): 








h. Educ. Service Agency 


35 


31 


. 41 


25 


i. State Educ. Agency 


19°" 


13 


10 


38 


Knowledge Sources (scale score**): 








* j. Paper 


2.76 


3.10 


2.76 


2.14 


k. Institutional 


1.95 


2.05 


2.15 


1.45 


Strategies (% who mention): 










1 • Expertise 


19 


59 


15 


19 



* Th.e overall score included field agents who were in mixed, as well as 
pure-type categories. There were five respondents who did not report 
sufficient data to be included in this analysis. 



** The scales represent the- average of the items that a factor analysis; 
indicated cohere as. a set. The metric runs from 0 = never to 4 = weekl 
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Knowledge sources . Two of three factor scores (based on abactor 
analysis cof 18 knowledge sources items) showed significant differences 
among agent types.* The overall scores in Table 6 (items j and k) indicate 
that field agents turned to^paper* sources (newsletters, educational journals, 
curriculum materials, text books, and technical reports) more frequently 
than they turned to institutional sources (state department of education, 
federal agencies, professional associations, regional advisory committees). 
As might be expected, given their marked differences in writing activities, 
Experts/ Trainers turned to paper sources more often than did Monitors. 
Both Experts/ Trainers and Liaison types turn more frequently ,to 
institutional sources than did Monitors. 

Strategies . Among the particular strategies agents mentioned that 
they employed in creating an interest on the part of school districts for 
ESA services, only one—exhibiting an expertise in an activity or content 
area--showed a- statistical difference among pure role types. This 
strategy was used almost exclusively by Experts/Trainers. 

RoTe Combinations . Table 7 displays th* distribution of Field 
Agents by role type. 

* 

More on enforcement and monitoring . Table 6 shows that monitoring 
was mentioned by 43 percent of the total sample of 133 agents but rarely 
by pure Liaison type agent (8%) and only occasionally by pure Experts/ 
Trainers types (24%). Moreover, Table 6 indicates that all three of the 
types involving high monitoring constituted only 42 individuals (31 percent 
of the 133 agent sample). Since 41% of the total sample came from New 
Jersey County Offices where monitoring was the predominant field agent 
activity, we conclude that with the exception of two Pennsylvania IUs, 
nearly all the RBS data on "monitor" agents has been drawn from the New 
Jersey County offices. Huch of Firestone and Wilson (January 1982) * 
deals with ^description of these New Jersey County Office monitoring or 
enforcement roles. Firestone and Wilson noted that the New Jersey bounty % 
offices "represent one of the largest systems for [educational] enforcement 
purposes in the country." Before the T&E law was passed in 1975, the 21 
County Offices were staffed by 56 professionals. By 1978 this number - 
had nearly tripled to 155 professionals, all with some formal responsibility 
to monitor compliance with state and federal legislation. With 573 
public school districts in the state, there are only approximately four 
districts per. County Office professional staff member. However, the 
County Offices have a broad monitoring mandate including T£E compliance, 
tenured teacher evaluation regulations, budgeting procedures, building 
codes, and federal laws. All 2,411 schools in the state are to be visited 
annually. The RBS interview data indicated that many agents downplayed or 
redefined their work as an assistance activity. 

The primary thought in our work is not to- act as a 
monitoring agent. I don't do checklist monitoring. 
I feel more like a TA [technical assistance] person. 
I help districts identify needs. 
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In the. internal kind* of work we do here, we try to 
provide service kinds of activities to local districts 
in terms of helping them to meet all of the state 
and federal requirements for all the kinds of school 
programs that they offer. 

A lot of my time (oae-half to two-thirds) is spent 
on the phone answering field questions. The rest of, 
n\y time is spent doing policy clarification and giving 
solutions to problems in meeting state guidelines and 
mandates for special education. 



Table 7. 



Distribution of Field Agents By Activity Type* 



ACIVITY 


TYPE 


NUMBER 


PERCENT 


Monitor 


only 


19 


14% 


Trainer 


only 


17 


13 


Liaison 


only 


13 


10 


Monitor- 


■Trainer 


7 


5 


Monitor- 


■Liaison 


15 


11 


Trainer- 


■Liaison 


22 


17 


Monitor- 


■Trainer-Liaison 


1 


1 * 


None 




39 


29 




TOTAL 


133 


100 



Field agents were classified into hone, one, two, or all three of the 
activity types if they scored in the top third of the particular 
activity score" distribution. 
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Firestone and Wilson suggest that there were two reasons for enforce- 
ment staff to deny or down play. their monitoring and enforcement roles. 
First, nearly all of the county office staff are drawn from the population 
they monitor. Most (83%) had previous work experience in education as 
teachers or administrators, and more than, two-thirds of those who scored high 
in the monitoring area reported that they received their highest degree 
from an institution within commuting distance of the region they now serve. 
Second, the New Jersey Department of Education lacks the political power 
to monitor aggressively even if field agents wanted to. This *is evidenced 
by the legislature's threat in 1978 to cut the budget line for county 
offices by $1 million and by charges by both candidates for governor 
in 1981 that /the system for monitoring was was.tef ul , expensive, and in need 
of change. 

Given the interest of these field agents' in changing their monitoring 
roles and also recent outside criticism, Firestone and Wilson looked again 
at the 32 dimensions on which they had compared all three pure types 
(see Table 6). This time they compared pure monitors (N = 19) with only 
pure trainers (N « 17) and monitor--tra.tnens (N~=~7)~r ~In~a~second^comparison 
they compared pure monitors (N = 19) with pure liaison agents (N = 13) 
and monitor-liaison agent (N = 15).* Most of the differences between 
the pure types have already been presented in Table 6. However, when 
-only thepure trainers and the pure monitors are compared, the two types 
also differed significantly on the percent of time spent on long-term 
projects (21.5% for pure trainers vs. 11.6% for pure monitors, with 
monitor-trainers at 18.2%). Pure trainers also spent significantly more 
time with teachers (42%) than did pure monitors (21%), and again trainer- 
monittfrs were intermediate (30%). School districts were more frequently 
the initiators of contacts for pure trainers (47% of all contacts) than 
for pure monitors (30%). However, in this case trainer/monitors had 
even a lower percent of school district initiations of contacts (26%).** 
Finally, in addition, earlier difference found in the use of expertise 
as a strategy, there was a statistically significant difference between 
pure trainers (71%) and pure monitors in their use of media as a strategy 
for creating interest and for delivering services. On this measure the 
trainer-monitor group had an even lower percentage (14%). 

When monitors were compared with liaison agents only seven differences 
were found: (1) content-administration, (2) activity-monitoring, (3) 
intensity-number of long-term contacts, (4) initiation of contacts by 
state, (6) knowledge source-paper, and (7) knowledge source-institutional. 



* Footnote 2 to Table 3, p. 32 in Firestone and Wi 1 son, .January 1982, 
erroneously labeled the symbol for "monitor-liaison" means as "monitor- 
trainers." 

** Anfong the 14 significant comparisons involving pure trainers, pure 
monitors, and trainer-monitors, the trainer-monitor group mean was inter 
mediate on 8 of the .14 measures. However, it was more extreme than the 
pure monitor group on 6 of the measures and was never more extreme than 
the pure trainers on any of the measures. The three most remarkable low 
scores for trainer-monitors were their low percent of mention of the 
curriculum content area (14%) and their low mention of expertise (0%) or 
media (14%) .as strategies for creating interest and delivery services. 
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The means for the two pure types for these significant comparisons are . 
all reported in Table 6. 

Summarized briefly, liaison specialists provided more assistance on 
administrative matters, they engaged 1n much less monitoring, they worked 
on more long-term projects, they found that their contacts were initiated 
more by the FSA and less by the state than did monitor agents, and liaison 
specialists used a wider range of paper and Institutional knowledge 
sources. 

The monitor-liaison is much more a blend of the two pure types, than 
is the monitor-trainer. With one exception where the monitor-liaison 
group mean very slightly exceeded the mean for*pure 11a1so,n agents 1n 
(high) use of institutional knowledge sources, the means for. the liaison 
group were always intermediate between the two pure types. Monitor- 
liaison scores were closer to pure monitors on three dimensions (adminis- 

-t r-ative-content ^.monitoriJig^a.c.tj^nles i^andL percent „ of ESAJ nUia ted 

contacts) but v : re more nearly in the middle range on the remaining 
three measures. 
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IV. CROSS-STUDY- SYNTHESIS 

„ In the previous chapter we summarized the findings of five recent 
studies of programs that employed external linking agents to assist 
schools in using external ly-generated knowledge to solve problem^ and 
improve educational practices. In this chapter we shall compare the 
studies in the context of five, topics: 

A. Gross Similarities and Differences in Linking Agent 
Roles Across the Projects 

B. Selection, Training, and Support for Linking Agents 

C. Linkinfl Agent Work 

D. Linking^Agent^Effects and Outcomes 

E. Effects of Program; Host Organization, and Clients on 
Linking Agent Activity 



A. Gross Similarities and Differences in 
Linking Agent Roles Across the Projects 

Location of linking agents by type of agency/service region and by 
type of school improvemont program * Table 8 presents the data on the 
location of 428 linking agents who are described in the five studies 
summarized in Chapter III. In this attempt to classify these 428 agents, 
the available data for several of the studies' posed problems which were 
resolved as indicated below. The organizations are listed in descending 
order by increasing geographic scope of the agents 1 service region . 
With respect to LEA-service agents, it should be noted that the DESSI,- 
RDU, and RBS/LSI studies, provide information on the roles of various LEA 
staff (e.g., superintendents, central office staff, principals, teachers, 
others) who assisted in their school improvement projects, but only the 
SDGP in its presentation of information on agents confounds .local LEA 
linking agents with external linking*agents. Thus, though more than 
two-thirds of the SDGP sample of linking agents (69%) was LEA-centered, 
almost none of the linking agents in the other four- studies were LEA-centered.* 
Next closest to the LEA are the Educational Service Agencies (ESAs) 
where nearly t\alf (47%) of all the linking agents were located. Because 
the RBS/ESA stucty strongly indicates that agents in compliance-oriented 
ESAs are far more heavily oriented toward monitoring than toward providing 



At least 39 of the DESSI study agents were LEA-based, but only one of 
these agents, a Title IV-C local consultant, confined service to a single 



local LEA. 
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other forms of technical assistance, we have subclassif led the ESAs on 
the basis of the predominant orientation of the type of agency in which 
the agent was located.* 

Agents from predominantly service-oriented FSAs constitute one-third 
of the total sample. They represent approximately two-thirds of the RDU 
agents and the RBS/ESA agents and nearly one-fourth of the SDGP agents.** 
Three studies (SDGP, DESSI, and RDU) employed some agents operating primar- 
ily at the. state level--in SEAs, 4 1n other state-level service projects (i.e., 
in non-SEA-based NDN State Facil itator, projects or in the RDU-N^A state 
association offices), orjn Institutions of Higher Education (IHEs), 
which may view their school service regions as state-wide or as somewhat 
larger or smaller than state-wide.' The numbers we have assigned to each 
of these three categories of state level agencies involve some guesswork, 
but may not be too much in error.*** The RBS Local School Improvement 
Study (RBS/ LSI) was totally laboratory-based. In addition, one RDU study 
agent was laboratory-based. Classification of /the NDN D/Ds poses problems 
"because we* have no published information identifying the - 68 D7Ds included 
in the DESSI study. Most D/Ds are located in LEAs, but some are located, 
in ESAs, colleges and universities, regional laboratories, and nonprofit 
agencies. However, because neaVly all D/Ds take a national service 
orientation, we have treated them as a separate group, rather than class- 
ify i/ig them by type of host agency.**** 

The data in Table 8 indicates that there are marked contrasts among the 
five studies in the distribution of agents by type of agency, and especially 



*0ur allocation of 56 of the 138 RBS/ESA agents to compliance-oriented 
ESAs is somewhat arbitrary. Firestone and Wilson, January, 1982, p. 30, 
indicate that at least 42 agents scored in the top third of their "moni- 
tor" scale. However, it appears that perhaps all 56 agents from the' 
New Jersey county offices and an unknown number (perhaps 10 or 12) of 
the agents from two of the 11 Pennsylvania Intermediate Units in the 
sample were located in predominantly "compliance-oriented" agencies. 
Hence the actual number of agents in compliance-oriented ESAs may be 
from 42 to 68. 

**A few of the NDN agents in the DESSI sample were also located in ESAs; 
however, we have classified these agents by their service region; 
state, if State Facilitator, and national, if 0/D. 

***The SDGP and DESSI figures are fairly accurate. We know that the 
NEA RDU project had 14 agents, but had to guess as to their location 
in the SEA or in the NEA state association office. 

****We note that all six of the 'NETWORK'S RDU agents were affiliated 
in some way with NDN. One agent was located in a regional laboratory 
and another in an IHE-based Teacher Center. We have classified the 
other four as being most like D/Ds, although some could have also been 
classified as belonging to "other state" or to ESA-service agencies. 
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Table 8 . Location of Linking Agents by Type of 
. Program And Organization 



Organization 
Type 


» Dam r\ n 

f>ey i oil 


School Improvement Program* 


-Total 


- 

Percent 


SDGP 


RBS/ESA 


DESSI 


nnt i 

RDU 


n d c /I c T 

RB5/LM 


LEA ' 1 ♦ 


1 oca 1 


94' 




1 




- 


95 


.' -22% 


ESA - Monitor 


sub-state 




56 




t t 




56. 


13 


ESA - Service 


sub-state 


32 


82 


9 


33' 




156 ■ 


36 


SEA 


state 


9' 




1 


' . 6 




22 


5 


* 

Other - State 


state 






31 f 


8 




39 . 


9 \ 


I HE ' 


state (?) 


— 

1 




4 


1 




6 


1 


Labs 


multistate 






a 


1 


'6 


h : 1 


2 " 


D/Ds 


national 


* 




43 


4" 




-47 


11 


Total 




136 


138' 


95 


• . 1- 
. 53 


" 6 


428 


'99\ 


Percent . 




32% ' 


32- 


22 ' 


.12 


1 


99 












36 




• 



State Dissemination Grants Program 

Research for Better School's study of Educational 

Service Agencies' 
Dissemination Efforts Supporti ng School ' 

Improvement 

Research and Development Utilization program 
Research for Better School's Local School 
Improvement study 




^Program Abbreviations 

SDGP 
RBS/ESA 

DESSI 

RDU a 
RBS/LSI 



in terms of the service regions served by these types of agencies. More 
than two-thirds of the SDGP's agents are locally oriented, whereas more 
than two-thirds of the DE SSI" study agents are nationally oriented* Nearly 
two-thirds of the RDU agents are based in ESAs serving portions of a state, 
and, of course, all the RBS/ESA study agents are located in these intermediate 
units. Finally, all the RBS/LSI agents are based in a regional laboratory. 

We have ordered the five projects from left to right to correspond, 
at least roughly, to Karen Louis 1 dimensions of agent scope and intensity 
(see ChapteMI, Section'B, pp. 2.20-2,2). Typically, SDGP agents served 
many individuals in several, sometimes many, school districts. Although 
there were exceptions, the agent's task was primarily confined to determin- 
ing client information needs, forwarding information search requests to an 
information specialist, and then sometimes making deliveries and* helping 
.clients to screen, select, interpret, or perhaps even apply the retrieved 
information. SDGP agents vOften were confronted with a very, wide range of 
requests for virtually any type of educational information from a broad 
range of types of information users. However, their role was primarily 
that' of an information "resource finder" (i.e., retrieval of citations, 
abstracts, bibliographies, and sometjmes copies/of journal articles or 
reports). Probably next up the scale of intensity (and down the. scale of- 
scope) are the RBS/ESA study agents. Although Firestone and Wilson found 
three major field agent role ty'pe$^(curri culum expert/trainer, liaison, ' 
and monitor) as well as all combinations of these types, their data also 
clearly indicate that the monitor and the curriculum expert/trainer roles 
are those that differentiate agencies. All New Jersey County offices had 
agents with very high means on the monitoring role score and relatively 
low means on tjhe curricul urn expert/trainer role score. The reverse held 
true for the New Jersey EICs and a great majority (9 of 11) of the Penn- 
sylvania Intermediate Units; these agents were low on monitor scores and 
high on curriculum expert/trainer scores. In general, monitor agents 
confined their school ^improvement activities to relatively-, simple forms of 
technical assistance that were primarily focused on school administrators. 
"Pure" monitors engaged in an average of 2.3 long-term projects with 
LEAs'per year, spent an average*W 11.6 percent of their time on such 
projects and spent only- a fifth of their LEA contact time with* teachers. 
By^contrast, "pure" curriculum expert/trainers engaged in four to five 
times*as many long-term projects with LE'As, tended "to .spend roughly twice 
as much of their time on long term projects with Schools, and 'spent twice 
as mych of their LEA contact time (,42%) w.ith teachers. However, none of 
these ESA roles afforded much opportunity for intensive work with a few* 
-client schools. Generally, the work .was, relatively broad in scope. County 
office sta'ff were expected to monitotf compliance with a wide range of federal 
and state laws and regulations. Although EIC an'd IU agents sometimes special- 
ized in a. particular curriculum area (e.g., reading or bilingual education), , 
they often dealt with any grade leve\--from preschool to college programs. 

v By comparison, the majority of ;the DESSI stu<ty agents were associated 
wjth NDN, and most were Developer/Demonstrators (D/Ds) special i-zing in 
assisting schools to adopt just one program. The scope of the NDN State 
Facilitator {$?) theoretically was much broader, but was at least confined 
to familiarity with some or all of the approximately 120 to 140 D/D projects 
(circa 1979-1980) listed in the NDN catalogue, Educational Programs That Work . 
However, both the SFs and the D/Ds served a relatively large number of 
clients (see footnote, p. 2.22.). 
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The RDU agents had a much smaller scope in terms of the range of know- 
ledge resources they dealt with, and they served far fewer clients (3 to 
12 sites per ager<t) at a mych higher level of intensity, whether measured , 
in clock- or calendar time.. They were also generally expected to deal with 
a much broader range of assistance skills that typically involved signifi- 
cant aspects of "process helping" and "solution giving." Indeed, the RDU 
agents also aimed to build, and partly succeeded in building, local capac- 
ity to replicate aspects of the problem-solving process itself-. 

Probably anchoring the end of the scope/intensity continuum were the 
RBS Local School Improvement study agents. Her.e, six agents worked with 
five sites and averaged more than two visits a month during the school year, 
in addition to numerous telephone calls. The RBS planning process appar- 
ently placed great demands on agents and client schools, a condition that 
often forced agents to assume many different technical and mediating roles. 

However, despite the (real) differences in scope and intensity among 
the last three projects (DESSI, RDU, RBS/LSI), they are more alike than 
different when contrasted to the ESA orHhe SDGP agents. Agents associated 
with the former three' projects all tended to work with a relatively small 
number of school sites, often worked with a local pTanning team (teacher, 
principals, sometimes others) and focused on assisting schools* to define 
major education needs, search for appropriate, effective, (and it was 
hoped, R&D-based or practitioner-validated) programs and products; and then 
assisted schools in implementing these innovations. Moreover, to some 
degree, many attempted to institutiontal ize not only the innovation, but 
also the problem-solving process by which it was selected and implemented. 

It thus appears that perhaps three modal forms of assistance, or dom- 
inant linking agent strategies, are represented in this sample of studies,' 
each'representing approximately a third of the total sample of agents: [l) 
bibliographic and curricular information utilization (SDGP) V (2) lagal and 
programmatic knowledge utilization, including some consulting, technical 
assistance and training (RBS/ESAs), and (3) rational problem-solving fo- • 
cused (primarily*) on the adoption and implementation of validated prod- 
ucts and programs (DESSI, RDU, RBS/LSI). 

Classification of agents by dominant school improvement strategy and 
by size of agent service region . If we classify the sample of 428 linking 
agents by these three dominant strategies— (1) information-use assistance, 
(2) technical assistance, and (3) problem-solving/program implementation-- 
and then cross-classify them by three levels of size of the agent's service 
region— (1) local, (2) intermediate, and (3) state, multistate, or national- 
we obtain the distribution shown in Table 9. These data strongly indicate 
that the great majority of the agents associated with each domirvant strategy 



*The DESSI study included 12 local Title IV-C consultant/trainer agents 
who may or may not have subscribed as fully to this third strategy. 
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Table 9 . Number and Percent of Linking Agents Distributed by Size of Agent 
Service Region Within Major School Improvement Strategies 
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DOMINANT SCHOOL IMPROVEMENT STRATEGY 


TOTAL FOR 

ALL 
STRATEGIES 

9 


Information 

Use 
Assistance 
(SDGP) 


Technical ' 

Assistance 

(RBS/ESA) 


Problem- 
Solving 
Program 

Implementa- 
tion 

(DESSI, RDU 
R3S/LS I ) 


Size of Agent 
Service Region 


Nr 


col. % 


Nr 


col. % 


Nr - 


col. % 


Nr 


col. % 


, Local % 


94 


69% 




0% 


1 


1% 


95 . 


22% 


Intermediate 


32 


\ 


> 138 


100% 


42 


. 27% 


212 


BOX 


State, Multi-State, 
and National - 


10 


7% 




0% 


111 


72% 


121 


28* 


TOTALS 


136 

* 


100% 


138 


100% 


154 


100* 


428 


100% 



are to be found working within a service region of a particular size. 
Most of the information-use agents (69%) are found at the local level. 
All technical assistance agents are found at the intermediate level.* 
Most of the problem-solving/program implementation agents (72%) operate at 
* state, multistate (i.e., regional), or national service levels. These _ 
particular distributions are purely descriptive . We have nothing approach- 
ing a random sampling of agents or school improvement programs within the 
United States that would permit us to generalize these results for the • 
nation. However, the trend is at least provocative. It suggests that, as 
agents decrease the number of cMents they serve in order to increase the 
intensity and breadth of services they provide to clients, the more likely, 
it is that the agents will be operating in programs n that are state, region- 
al, or national in their service orientation. Viewed in another way, this 
notion suggests .that the knowledge and skills required to accomplish the 
more complex, specialized and costly types of school improvement assistance 
may be in relatively short supply and thus are typically found only in the 
organization of major federal and state dissemination programs, whereas 
simpler and less costly services may be provided by many education special- 
ists located in intermediate agencies and local school districts throughout 
the country. If this is so, the sobering fact is that both the RDU and 
the RBS/LSI programs were experiments that have been completed. Support 
for the existence of most of the DESSI agents is now severely threatened 
by Chapter 2 of the Education Consolidation and Improvement Act (ECIA). . 
The "New Federalism" of the Reagan Administration may bring with it the demise 
of most of the more complex and ambitious strategies for school improvement 
that have been predominantly supported by federal funds, thus leaving 
schools with only less costly and intensive forms of external assistance. 



B. Selection, Training, and Support for Linking Agents 



Selection, training and support for linking agents have been issues 
of interest to designers and managers of programs employing linking agents 
almost since their inception. Havelock and Havelock's (1973) Training for 
Change Agents represents one of the earliest training resources specifically 
designed for "linking agents." However, at nearly the same time, the U.S. 
Office of Education had commissioned a major training resources; development 
project to support its Pilot Stats Project (Mick, et.aU, 1973). This 
resource includes a set of 28 training modules for Pilot State Project 
directors, resource personnel, and field agents. Many of the training 
resources available at the time the projects included in this synthesis 
were initiated or operating are catalogued in the Educational Dissemination 



*This particular result is obviously an artifact of our choice of studies 
and the arbitrary method of study classification. Note also that inter- 
mediate-unit-level agents are, in fact, involved in all three types of * 
strategies, and represent nearly half (47*) of the total sample. Inclusion 
of the RBS/ESA sample mainly introduces a third. type of strategy, tech- 
nical assistance, that is undoubtedly performed to some degree at all 
levels, but is probably performed most frequently by agents serving 
local (e.g.,' school district central office) or intermediate levels. 



4.7 

126 



33 



and Linking Agent Sourcebook (NIE Cooperative Project, 1977), and in 
Rosenau (1977),. The importance of -training and support for educational 
- 1 inking_agents "has received attention from several writers (£ie1e, 1975; 
Jung7"1976; Crandal 11 ,1977; "Butler & Paisley, 1"9T8; flood S Cates, 1978; 
Paisley, Grimes, Reisinoer S Moir, 19/9). Selection Jias received much 
less attention (CrandalT, 1977; Hood '& Pool, 1978). However, aside from , 
brief treatment of training issues in the evaluation of the Pilot State 
Project (Sieber, Louis & Metzger, 1972; Louis & Sieber, 1979), along with 
some test data produced in the development of various training resources 
or assessment instruments, there has been little truely empirical research ^ 
-concerning the effects of selection, training, or support for linking agents. 

When "we turned to the five studies reviewed in Section III, we sadly . 
discovered that there is no opportunity for a synthesis: Four of the five 
studies provide no usable information whatsoever. However, this is jiot 
true of the RDU study. Spencer . and Louis (1980) provide a fairly compre- 
hensive report. It includes descriptions of training and support activi- 
ties for each of the seven RDU projects, an analysis of RDU linkers' own 
assessment of the training and support they received, statistical analysis 
of the impact of training and support on job-related attitudes and behav- 
ior,' and a discussion of overall findings in terms of implications for im- 
proving training and support of external linking agents. We shall conclude 
this section by summarizing some of the Spencer and Louis statistical find- 
ings. We also urge readers who are interested in these issues to read that 
report, since it contains much more information than is summarized below. 

The chapter on impact of linker training and support provides one of 
the few available sources of substantial data (N < 51) on the relationships 
among: (1) training variables (linker perceptions of amount received , use- 
fulness, satisfaction with timeliness of training, and satisfaction with the 
amount of training); (2) suppport variables (linker assessments of amount 
and usefulness of support for two roles, process' helper and resource finder, 
from four sources, RDU project staff, host organization, other linkers, and 
expert consultants); (3) intervening variables (age of linker, percentage 
of time devoted to role, previous teaching experience); (4) linker attitude 
outcomes (sense of efficacy , overall job satisfaction , role conflict ); and 
(5) linker behavior expectations , i.e., "to what extent do you actually per- 
form these roles as a linking agent?" ( process expert, three items; 
content expert, three items; general support, four items; reactive style, 
three items; proactive styije, three items).*. 
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*There were ten linker behavior role items. The items in each scale 
were as follows: • • f 



Process expert ; 
Content expert: 



General support : 
Proactive style : 
Reactive style: 



an evaluator^ a process trainer; a conflict resolver. 
an expert in assessing the match between innovations and 
problems; a program implementor; a basic skills, career 
ed. , or in-service specialist. 

an observer/historian; a resource person; a counselor 
or hand-holder. 

a process trainer; a program implementor; a conflict re- 
solver. 

an observer/historian; a resource person; a counselor 1 



or hand-holder. 
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The correlations between training variables and the outcomes of job- 
related attitudes and behavior can be summarized as follows: 

(1) There were no significant relations (20 correlations) among 
four training variables and five behavior variables. 

(2) Among 15 correlations relating training to attitudes, only 
two were significant. Increased training is negatively re- . 
lated to perceived role conflict (r - -.46); the increased 
training provided linking agents with a clearer definition 
of their own roles and with techniques for dealing with 
roles. However, perceived usefulness of training was neg- 
atively related (-.50) to' linker sense of efficacy (per- 
ceived influence over site outcomes). This finding is 
interpreted as an example of how training can be selectively 
effective, i.e., "linkers who had a high sense of efficacy may 
have been less impressed by the relatively simple training 
tools and experiences that were provided to them late in their 
project-related careor. Linkers who felt less sure of what 
thoy were doing were more grateful for the information and 
clarification that were derived through training sessions 11 
(Spencer & Louis, 1980, p. 56). 

(3) The 16 linker support variable produced 19 significant 
correlations (out of 128) with eight attitude and behavior 
variables.* Several patterns of impact are indicated. 
Greater support (amount and usefulness) from consultants 
(with respect to either the process or the information roles) 
increased linkers' reported performance of a content specialist 
role. Greater support from other linkers, especially in 
terms of perceived usefulness, and especially in the process 
role, showed significant relationships with the linker's reported 
behavior in* process specialist and generalist roles and also 
greater emphasis on supportive, reactive roles and on proactive 
roles. Greater amounts of support from project staff (1n ~~ 
either process or information roles) seemed to reduce linkers' 
sense of role conflict. However, higher levels of support 
(either in perceived amount or usefulness) related to process 
roles was associated with lower levels of perceived efficacy. 
Spencer and Louis hypothesize that linkers with a low sense of 
efficacy may seek local support frequently and rely on it as 
useful. 

In an additional analysis, Spencer and Louis computed 
canonical correlations among four pairs of sets of variables: support 
and attitude, support and behavior, training and attitudes, and training 



*Due to variable Ns (31 to 35) for these data, p < .05 significance levels 
vary. The range of absolute values among the 19 significant correlations 
is from .32 to .46, with a median .37. Thus none of the significant 
relationships between support and training outcomes Is particularly 
strong. 
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and behavior** The results were disappointing. None of the four canonical 
correlation analyses resulted 1n a canonical correlation that was significant 
at the .05 level. In other words, there is no evidence of a strong rela- 
tionship between training or support and attitudes or behavior for the 
entire sample of linking agents. ™ 

A somewhat different set of findings were produced, however, when the 
effects of moderating variables (age, teaching experience, percentage 1 of the 
time devoted to RDU linking role) were examined. Each of these moderators 
was categorized and nominally coded. 

Age . The analyses show that training and support had the strongest 
effects (correlations in the .6 to .9 range are reported) on the youngest 
under age 33) linkers and the next strongest effect on the oldest linkers 
over age 48), but there were almost no significant correlations between 
support or training and linker job attitudes or behavior for the middle- 
aged group of linkers. Moreover, there were differences in the pattern of 
relationships for the youngest and the oldest linker groups. Spencer and 
Louis hypothesize that both younger and older linking agents are more open 
\o influence; younger linkers, -because they realized they are Inexperienced 
and need support; older linkers, because the change in job status may be 
more disruptive for someone who has been engaged in more traditional roles 
ihf education. 

Teaching experience . Teaching experience also produced contrasts 
among three levels *of experience; for example, among inexperienced (less 
than three years) teachers, the amount of training was negatively associ- 
ated with job satisfaction (-.72); among moderately experienced (three to 
five years) teachers, training was positively associated with job satisfac- 
tion (.77); among the more experienced (over five years) teachers, there 
was no significant correlation. 

Percentage of time in RDU role . This moderator variable produced few 
significant results. Those who committed least time (five to 12 percent) 
were more likely to be affected by differences 1n support structure. For 
example, low-time RDU linkers who had more support from other linkers 
were more likely to have low role conflict, were less likely to play the 
role of a content specialist, and were less likely to take an involved or 
proactive stance with clients. Among those committing between 12 and 50 
percent of their time to RDU, very few significant relationships were 
found (however, perceived usefulness of training was related to playing a 
content specialist role, r = .82; process support from the linker's host 
organization was negatively related to job satisfaction, r = -.87). Finally, 



^Canonical analysis is a technique for finding the maximum correlations be- 
tween one set of variables and another set of variables. Stated briefly, 
canonical analysis finds a weighted combination of all variables in one 
set that has the maximum correlation with a weighted combination of all 
variables in the second set. An anlysis may produce none, one, or several 
statistically significant relationships among differently weighted combin- 
ations. 
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among those who committed more than 50 percent of their time, training 
and support variables Fiad almost no significant relationship on attitudes 
or role behavior, the only significant relationship was a negative one 
(-.69) between perceived usefulness of training and sense of efficacy. 

Spencer and Louis tentatively conclude: ". . . The types of training 
and support systems that were employed in the RDU project were not 
sufficiently robust or intrusive to counter the basic autonomy of the 
linking agent" (p. 62). They note that data in other RDU reports show 
that these linking agents tended to be most highly influenced by clients. 
In addition, it appears that predispositions and convictions, as well as 
previous job experience, may have greater influence on linker attitudes 
and role expectations than do training or support systems* However, the 
results do indicate that the support systems designed by the RDU projects 
or developed by individual linkers were more significant in shaping 
attitudes and role expectations than were formal training events sponsored 
by the project. One of the significant differences was that training was 
initiated by projects, whereas support systems tended to respond to 
linker requests. "Thus, support may be thought of as being more situation- 
and linkers-specific, and usually deals with immediate problems and problem 
solutions. ... The need for individualized approaches is highlighted 
by the fact that linkers with different background [age, years teaching 
experience] were affected by levels and sources of support in different 
ways. While- the quantitative data that we have do not suggest clear 
patterns for the design of a contingency theory of training^and support 
needs, they do suggest the clear need for such an approach." (p. 62) 

The issue of selection remains largely unexamined. Although RDU 
project designers exercised considerable choice over which particular 
host agencies they chose to work with, the choice of agents was almost 
always a host agency decision over which RDU project directors had 
little or no direct control. In another RDU report, Louis and Kell 
(1981, p. 171) conclude that the RDU data on agents do not suport a 
"science of selection." The only characteristics of agents that emerged 
as significant were agents' age, teaching experience, and disposition 
to be "innovative" (inquiring, original, self-reliant, flexible) versus 
being supportive and low-profile (cooperative, dependable, industrious, 
stable). Teachers and principals both were more satisfied with agents 
disposed to the latter style. Older agents and agents with more teaching 
experience were more likely to play content specialist roles that reduce 
role conflicts and job stress, but were less likely to perform central 
boundary-spanning activities and generalist-coordinator roles. Although 
significant, the influence of these characteristics is not large. It 
appears that many different types of -persons can perform effectively in 
these RDU field agent positions. 

The concluding chapter of the Spencer and Louis report presents 
recommendations for improving training and support. In their conclusion 
to that chapter they question the value of greatly increasing the amount 
of training due to the expense. An alternative approach, suggested by 
the linkers themselves in interviews and conferences, would be the 
provision of resources to encourage and maintain opportunities for * 



linking agents to interact with each other and with a broad range of 
other resources such as those found in universities, district and state 
education agencies, educational laboratories, and R&D centers, and at 
national conferences on the dissemination and utilization of knowledge 
and new practices. 



• 
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C. Linking Agent Work 



If only one study provides us with much information on training and 
support for linking agents, quite the opposite situation is found when we 
turn to the issue of linking agent activities and roles, ftll five of the 
studies provide some information, although, again, we find the richest set 
of data in the Abt study of RDU agents. In section IV. A, we noted that, - 
the agents described in the five studies could be grouped in terms of three 
dominant school improvement strategies: (1) Information Use Assistance, 
(2) Technical Assistance, and (3) Problem-Solving/Program Implementation. 
We further noted that these strategies and the studies of programs. employ- 
ing them could be organized along a dimension of decreasing scope and in- 
creasing intensity of linking agent work. As we examined the available 
data on linking agent work, it appeared that this dimension helped substan- 
tially to clarify differences among the studies in their findings concern- 
ing linking agent work, so we shall employ it again in this section by re- 
viewing the studies in their order of decreasing scope and increasing l£- 
tensity . 



1. State Dissemination Grants Program Agents 

One remarkable methodological similarity among the studies is the fact 
that four of the five employed factor analyse? of linking agent activity 
items to derive empirical descriptions, of linking agent roles. The first 
of these resu1ts>to be published was the NTS study of SDGP linker activi- 
ties and roles (Decad, Madey, Royster & Baker, April 1981). The Butler 
and Paisley conceptualization of three modal roles and their relationship 
with- selected Unking functions (see Chapter II, Figure 2) directly influ- 
enced the NTS study. In this study factor analyses of each, of six sets 
.of data produced essentially the same three factors: a communicating role , 
a resource finding role , and a facilitating role . Comparisons of "real" 
and "ideal" expectations of linkers themselves and of project directors 
revealed some small, but perhaps meaningful, differences in item factor 
loadings. However, the remarkable aspect of the NTS analysis is the ro- 
bust nature of those three factors. c 

Although directly emanating from the Butler and Paisley model, the 
results were not quite what was expected. Why did this happen? Technically, 
a major flaw in the NTS analysis may' be a too literal reading of the 
Butler and Paisley mbdel (Figure 2). Butler and Paisley were careful to 
label their figure "tftnee modal linking roles and their relationship with 
selected linking functions" (emphasis added). For purposes of *il lustration, 
Butler and Paisley graphically located each of 15 highly generic linking 
functions within their three^mode triangle. The NTS researchers selected 13 
of these 15 functions (omitting "manitoring products" and "evaluating 1 ') 
and then wrote an item for each function that provided one parenthetical 



♦ 

*With only six agents in the RBS/lsi study, factor analysis was not very 



practical . 
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example of each function, i.e., "Communicating (e.g., maintaining open 
personal communication with clients)." This particular Item illustrates 
the problem .of translating the Butler and Paisley schema to a very short 
item list. In the Butler-Paisley model I. communication is one of the 
most cSVitrally placed items, since they obviously realized that communi- 
cation would be an important part of ar& of their three modal roles. 
Moreover, it is obvious that linkers confront many communication chal- 
lenges beyond communicating with clients (e.g., communicating with resource 
base staff, host agaqcy staff, project directors, colleagues). Of course 
the "e.g." example'was intended as an illustration, but it can obviously 
bias the .response to the extent that the'item becomes "communicating with 
clients,"' which then, not unsurprisingly, results in its being empiricaT- 
ly associated with two other items: "Disseminating (e.g., sharing infor- 
mation with clients in a two-way process)" and "Marketing (e.g., promoting 
[client] awareness of available 5 services)." 



Another example of probably unintentional bias can be seen if we ex-, 
amine the four linking functions Butler and Paisley most closely associ- 
ated with the modal role of process helper : -'planning,' managing conflict, 
analyzing problems, Snd evaluating (see Figure 2). In the NTS items we 
find the following examples given: 

"Planning (e.g., preparing for future needs and services)" 

"Managing conflict (e.g., helping others resolve discord)" 

"Analyzing problems (e.g., translating client; problems 
into informational and resource needs)" 

"Evaluating" [No item was provided for this function.] 

As we examine these three items, we note that only the example given> 
for "managing conflict" contains any content that might be clearly related 
to the modal process helper role. However, this particular item was dropped 
from the analysis, apparently because it did not correlate very well with 
any of the other 12 items! The other two items contain examples that have 
no resemblance to the 'process helper role. Thus, with only one item to 
represent this role, and with only three factors extracted, it seems ob- 
vious why 'the NTS analysis failed to find a Process Helper role factor. 

Essentially the same type of reason can be given for the NTS analysis 
failing to find a distinct Solution Giver role. Among the five functions 
closest to this role (see Figure 2 again), the monitoring products item 
was omitted. The remaining four items were given these examples: 

"Marketing (e.g., promoting awareness of available 
services)" 

"Disseminating (e.g., sharing information with clients 
in a two-way process)" 

"Implementing (e.g. assisting clients to install a new 
procedure)" 
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"Producing (e.g., developing materials or procedures for 
client util ization)" ' 

Although "marketing" and "disseminating" are clearly client-orientqd, 
they hardly connote the image *of "overseeing the adoption and institution- 
alization of a particular innovation" (Piele) or the "entitlement to rep- 
resent one solution or set of solutions to the client . . ." (Butler arjd 
Paisley). And indeed, as we have noted, these two items join with the 
"•communicating" ifem to define the NTS "communicating" factor. Thus 
"implementing" and "producing";remain as the only two functions that are 
at all close to the Butler and Paisley Solution Giver roie. 

Because the NTS item set contained t 0 oo few items to define clearly 
either the Butler and Paisley Process Helper or Solution Giver modal roles, 
most of the items spanning the side of the Butler and Paisley triangle be- 
tween the Process Helper and the Solution Giver apexes (specifically, plan- 
ning, influencing, producing, and implementing) are combined into a genera-l 
"facilitating factor," whitfh in fact accounts for more than two-thirds (69%) 
of the common variance represented by the three factors in one of the NTS 
analyses of Unking agents (see Decad, Madey, Royster & Baker, 1981, p. 13). 
The second factor, "resource finding," accounting for only 19 percent of 
the common variance, is represented by .two .cems, both containing examples, 
with reference to information : "securing and arranging information for 
client problems" and "translating client problems into • informat-ion and re- 
source needs." Perhaps the most surprising finding of all is that the third 
NTS factor, "communicating," should account % only 12 .percent of the com- 
mon variance- As we have noted, it is represented primarily by three items 
(communicating, marketing, dissemination), .all with examples that have clear 
reference to very general communication with clients.. However, these three 
items are not very strongly associated; indeed, the average intercorrelation 
among these three items is only .43, which is only slightly higher than the 
average intercorrelation for the entire set of 12 items (.415). 

Now, beyond the rather limited and particular choice of items, there 
is another very important reason for the* NTS failure to find strong process 
helper or solution giver factors, as discussed in Section III. A., above. 
Namely, that approximately two-thirds of the SDGP linking agents in this 
sample were LEA-based. Table 1 (see Section II. A.) suggests that the 
gr.eat majority of LEA-based SDGP linking agents confined their services to 
"spread" or "spread and exchange" (of information). Very few became in- 
volved in "implementation."* Thus, neither the sample of items nor the sam- 
ple of subjects in the NTS study provides us with a very broad conception of 
linking agent work- However, the NTS factor analysis results are an excel- 
lent representation of agent work for those agents employing the Information 
Use Assistance strategy discussed in Section IV. A. (See Table 9.) After 
close examination of the items loading on each of the three NTS factors, we 



*The item means confirm this interpretation. "Implementing" ranked 9th 
and "producing" ranked 12th among the 12 items in the extent to which 
linking agents reported that they performed these functions. (See Decad 
et al. , p. 32.) 
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suggest that the NTS labels be made more specific, as follows: 

Factor I: Facilitating client know! edge utilization 

Factor II: Information resource' finding 

factor III: Communicating with clients ' - 

When we examine item means, we discover that among the three top- 
ranking items in order' of extent to which 'Unking agents report that 
they perform the Item function, "Communicat1ng--matntaining open personal 
communication with cli^ts" ranks first and "Dissem1nating--shar1ng Infor- 
mation with clients in a two-way process" 'ranks third.* 

Though communicating-with-cliehts items are high in frequency, the 
three lowest frequency items are: "Producing—developing materials or pro- 
cedures for client utilization" (ranking 12th; note that 1n the SDGP, this 
function tended to be performed by information specialists or others, but 
not by linking agents, especially not those who were LEA- or school-based); 
"Intervening—proactively seeking clVent needs" (ranking 11th; this Item 
displays modest loadings in the .grange on all three factors); and "Anal- 
yzing Information—determining the relevance of* information to client prob- 
lems . " . 

We noted in Section III. A." f Table 2, that 90 percent of the SDGP . 
linking agents classified by type involved some combination of "pure" or 
"combined" roles in which the "communicator" role played a prominent part* 
By contrast, linking agents who placed a relatively higher eiriphasis on In- 
formation resource finding and/or facilitating client knowledge utilization 
(than on communicating with clients) constituted only 10 percent of the 
sample. 

After examining the NTS data on the SDGP sample of Unking agents, we 
thus conclude that most of these NTS agents exemplify modest variations 1n 
functional patterns of essentially on^e of the three modal roles as defined 
by Butler and Paisley: the Resource Finder. Note how the "entitlement" 
for this role was defined:^ 

i 

• RESOURCE FINDER. At the lowest lever of entitlement, a 
linking agent serves as intermediary between the, client 
organization and knowledge resources. The linkfng agent', * 
may conduct information searches or make interpersonal 
* contacts to find answers to clients' quesjtions. The Unk- 

ing agent "negotiates" cLients 1 questions to make^them 
answerable, but does not undertake ah analysis of the 
client, organization to determine if the right questions 
are being asked, information is turned over to clients 
in the form of bibliographies, documents > briefing memos, 



*The second ranking item is "Monitoring Ideas— keeping abreast of recent 
educational practices and inncwations* " This particular Item has moderate 
loadings (.3 or higher) on ali- three of the factors. 
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etc* ,Only infrequent^ is the resource finder called ' * 
upon io make presentations to olients, and the structur- 
ing of information into a set of recommendations usually 
goes beyonq the entitlement of : his role* (Butler and 
Paisley, 1978, p. 30) 

» 

Note again that the three least frequently performed /items in the* * ^ 
NTS instrument were: "Producing—developing materials or procedures for 
client utilization"; "Interv.ening---[)roact ivfcly seeking client needs"; and,^ 
"Analyzing information—determining 'the relevance of information to client 
problems/' * <• 

It is also obvious that most'SDGP agents also assumed the unspecial- 
ized generalist or "scout" role identified by Butler and Paisley "that pri- 
marily involves communication functions alone." In temis of the special iza« 
tions triangle (displayed at the bottom of figured) we might depict the , 
work- of the SD6P agents as being "mapped" as shown in figure 5 (overleaf). 
Perhaps with more appropriate instraments and with a more conventional 
method of typing linkers, we might have found a few agents playing signifi- 
cant jdhjc^ jiel^^ However, given this sample 
of agents, we doubt that many would have been found. Rather, Butler and 
Paisley noted (1978, p. 32) that the boundaries between the modal roles are 
permeable and at least some linking agents seek to extend their entitlement 
from one role (here primarily General 1st Linker and then Resource finder ) 
to others.* There is some evidence that this was occasionally true of 
linking agents in the State Dissemination Grants Program. 



2. The RBS/ESA Study 

The RBS study of Educational Service Agencies (ESAs) provides the 
second factor analysis to be examined. • Firestone and Wilson (1982, p. 10) 
indicate that they began with responses to a list of 11 items "that 'come 
from previous role conceptualizations as discussed by Butler and Paisley 
(1978) and from preliminary discussion with field agents." Their list of 
11 "role items" is aptly named. Resource Finder is one, of the 11 roles, 
and Group Process Trainer (not Helper) is another. See S^qtionJII. E. ^ 
Table 5, for the full list. We thus see that the RBS items represent t^olfeSL 
themselves, as contrasted to the functions that compose roles used in the \ 
-NTS analysis. The result, then, is an analysis that starts at a more 
aggregate level of behavior than was examined in the NTS study. Moreover, 
the RBS roles obviously were derived mainly from discussion with ESA field 
agents. The role titles sound more realistic, e.g., Workshop Presenter, 



*Decad et al., p. 19, note that better educated and more professional exper- 
ienced linkers tended to play a Facilitator role more frequently. Edu- 
cation level of the linker was marginally related also to the Resource 
Finding role. 
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Figure Five 

A MAPPING OF THE NTS (SDGP)- FACTORS ON THE 
BUTLER-PAISLEY ROLE SPECIALIZATION TRIANGLE 




i 



Butler and Paisley Specializations 

A * Process Helper 

B * Resource Finder 

C 85 Solution Giver 

D ■ General 1st Linking Agent, 
"scout" 



NTS Factors 



I. Facilitating 
Client KU 

II. Information 

Resource Finding 

III. Communicating with 
Clients 
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On-call Consultant, Needs Assessor/Planner. Using* the conventional factor 
extraction- rule-of-thumb to retain all factors with Eigenvalues greater 
than 1.0, the RBS researchers extracted and rotated three factors. - 

Four of their roles --r Curri culum»Expert, Curriculum Designer, Workshop 
Presenter, and Group Process Trainer all displayed loading above .5 on 
the first factor, which was labeled Expert /Trainer . This factor extrac- 
ted 19 percent of the total variance and accounted for 44 percent of the 
common variance. However, two of the items, Curriculum Designer and Group 
Process Trainer, were the least frequently mentioned of the 11 items. 
After they omitted these two very-low^-frequency items, the simple average of 
the remaining two items, Curriculum Expert and Workshop Presenter, is 2.34 
on a scale that runs from 0 = "not at all" to 4 = ."a very great extent." 

Three roles -- Resource Finder, Needs Assessor/Planner, Coordinator — 
all displayed loading above .5 on the second RBS factor, which was labeled 
Liaison . This factor extracted 14 percent of the total variance in the 
set of 11 items and accounted for 33 percent of the common variance. How- 
ever, none of these three roles is in fact very well defined in terms of 
the .three factors, since, their commonalities range from .36 to .44. In oth- 
er wards, much less than half of the variance of these items is explained 
by the three factors. Moreover, the factor loadings indicate that these 
three role items .are not very strongly correlated with each other (correla- 
tions, in the .3 to .4 range). However, the simple average of the three 
items is 2.88 (and the average among agents from Pennsylvania Intermediate 
Units iS 3.01) on the 0 to 4 scale; thus, this loose cluster of three roles 
appears to contain some of the more frequently performed roles played by 
most ESA agents, with the one exception noted next. 

The role labeled "Monitor who identifies discrepanci.es between regula- 
tions and practice" was the only role item with a loading (-.67) above the 
+.5 cutoff on the third and last factor. However, three other roles dis- 
played positive loading of .3 or above on the third factor. They indicate 
tftat ESA agents who play heavy monitoring roles tend noit to play Proposal 
Writer, Workshop Presenter, or Curriculum Designer roles. These negative 
associations between monitoring and other roles help to account for the 
emergence and retention of this third RBS factor (with an Eigenvalue just 
above the 1.0 cutoff criterion). This factor extracted only nine percent 
of the total variance in the set of 11 items, but it accounts for 22 
percent of the common variance. The overall mean for this item was 2.23, 
slightly above the midpoint of the 0 to 4 frequency scale. However, as we 
noted in section III. E. this one item serves as a powerful discriminator 
of ESA agency types. The average for New Jersey EIC field agents on this 
item was 0.67; for Pennsylvania IUs agents it was 1.52, but for New Jersey 
County Office agents' it was 3.61. This is indeed a remarkable range for 



^Although not reported in the original table, our calculations indicate 
that the three factors account for only 42 percent of the total trace var- 
iance. None of the item communalities exceed .63; the average communality 
is .42 and one is as low as .17. We conclude that the correlations (not 
reported) among the 11 role items were generally low, perhaps with none 
exceeding .70. 
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means on a scale that ranges from 0 to 4. Three of the 11 RBS roles items 
failed to display loading above .45 on any of the three factors. They 
were On-call Consultant, Proposal Writer, and Sales Person. 

Now what can we really conclude fr ; om this factor analysis? Perhaps, first 
that commonly defined roles are something like brief job titles. They 
appear to identify the general work performed, but they really don't tell 
us very much specifically and probably convey a lot of ambiguity. 
Technically, we wish that Firestone and Wilson would have published the 
items' means, standard deviations, and correlations, as were provided in 
the NTS analysis. Without these data, we can only roughly estimate such 
things as correlations among the role items or the distribution of scores 
for the role items. However, the reported factor loadings make it clear 
that, among 11 roles, there were only two relatively weakly associated 
clusters of roles. The three factors accounted for only 42 percent of the 
variance in the. set of 11 items^. Thus, more than half the variance was 
not accounted for. In fact, over half the variance in the Monitor role 
item is not explained by the factor analysis results! The same holds true 
for all three of the role items that define the Liaison factor. And when 
we turn to the one cluster of items where three out of the four items dis- 
play communal ities above .5— the [Curriculum] Expert/Trainer group— we dis 
cover that two items were discarded because of very low (unreported) item 
means. The remaining two items appear to have a correlation that may be 
as high as .5. 

In this instance, factor analysis was a powerful tool applied to weak 
data. However, it way have served one useful purpose; namely, to suggest 
which items might be grouped to form the very small scales (of three items 
two items, and one item!) that were then employed in the subsequent analy- 
ses* Aside from this utilitarian purpose, we can't take the RBS factor 
analysis very seriously. The items are not well explained in terms of the 
factors, and the factors are not well defined in terms of the items. The 
main fault, of course, was the failure to provide enough items that would 
display some substantial patterns of clustered relationships for each an- 
ticipated factor. Had the RBS researchers asked about some of the . 
underlying activities or functions performed by agents playing these 11 
roles and then based their analysis on a larger set of items representing 
these activities or functions, they might have found a much richer and per 
haps far more interpretable analysis. As it is, we are left with the gen- 
eral conclusion that items composed of short common names for roles (e.g., 
Workshop Presenter, Coordinator) do not correlate very strongly with each 
other. Howevjsr, with the exception of one role, Monitor, most of the 
correlations w^re positive. 

Despite tnese technical problems, the remarkable point is that the 
role item scales, especially "Monitor" and "[Curriculum] Expert/Trainer" 
did discriminate powerfully among the three types of educational service 
agencies (EICs, Ills, and COs). Moreover, the field agents who were desig- 
nated as "pure" monitors were in fact very different in their contextual 
dimensions from agents who were either "pure" trainers or "pure" liaison 
types. Our best information on the work of ESA agents is found not in the 
RBS factor analysis results, but rather in their interview data with per- 
sons who scored high on the scales that were created. 
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3, The DESSI Study 



Cox and Havel ock provide the reader with even less information on' 
their factor analysis of the DESSI External Facilitators. We have the 
complete list of items and their means and a descriptive listing of the 
items that were associated with each factor, but no report of standard 
deviations, correlations, or factor loadings and no description of the 
factor method. 

Despite this massive lack of technical information, which we assume 
will eventually be published, we like the Cox and Havel ock list of items. 
It appears to have been built with an intent to .understand the details of 
an agent's work. It is clearly task- and activity-oriented and focused on 
the program adoption/implementation sequence. Initially, five categories 
of external assistance were identified: Initiating relationships, Assisting 
clients in deciding on new practices, Assisting clients in preparing for 
adoption, Assisting clients in implementing practices, and Follow-up 
activities. Then five or more items were prepared that described specific 
activities within each category. The final instrument contained 30 items. 
When factor analyzed, 27 of the 30 items were grouped into seven factors, 
and only three items remained unassociated with any one factor. In one 
case, "Making library and computer search for materials," the activity 
was very rarely done.* However, in the other two cases, "Assessing needs," 
and "Putting out fires," small, but significant, relationships were reported 
with several of the factors $ indicating that these activities were apparently 
relevant at several stages. 

Examination of the difference in item placement in the a priori 
logical categories and in the factor clusters reveals essentially the 
following. All the. activity items initially placed in the Initiating 
relationships category remained there, and with no additions, following 
the factor 'analysis. At the other end of the adoption/implementation 
sequence, the five items in the a priori Follow-up activities cluster 
formed two small factors: a three-item group concerned with evaluation 
and a two-item group concerned with continuation and developing new users. 
(The latter appears to be the least well-defined factor in the analysis.) 
However, the two intermediate, preimplementation a priori categories, 
Assisting clients in deciding new practices and Assisting clients in 
preparing for adoption, showed the greatest degree of regrouping: away 
from a logical temporal sequence and tow^vd the type of client involved. 
Note the factor labels: Administrator Adoption Preparation, Teacher 
Adoption Preparation, and Support of Teachers (which included one or more 
items from each of all three of the intermediate a priori categories). 
Among the five original items on the a priori Assisting clients in impleme 
ntation category, t k ee remained in a redefined Implementation Specifics 
factor. One item, "Putting out fires," as we have noted, showed modest 



*Well over half the DESSI External Facilitators indicated they "never" 
did library and computer searches for clients. These agents may have 
been "resource finders," but they were rarely information resource 
finders comparable to the SDGP agents. 



loadings on several* of the factors (Including Implementation Specifics, 
Administrator Adoption Preparation, Evaluation, and Continuation/ Diffusion) 
the fifth item, "Maintaining support among school personnel" (during 
implementation) joined similar items in other phases to create the Support 
of Teachers factor. 

We thus discover that the work of these DESSI "Solution Giver" agents 
is* organized in four distinct, pre- implementation clusters: 

• Awareness Initiation (initiating relationships) . 

• Administrator Adoption Preparation 

• Kacher Adoption Preparation 

[Maintaining] Support of Teachers [and other. school 
personnel] 

Maintaining the Support of Teachers continues into the implementation / 
follow-up phases, where three clusters of work are found: . 

• Implementation Specifics 

• Evaluation 

• Continuation/Diffusion 

As we noted in Section III. B. , |1 1 the DESSI External Facilitators, 
except the local Title IV-C consultants/trainers, displayed highly similar 
patterns in their frequency of performance of activities placed in these 
seven-factor work clusters. Their greatest emphasis of assistance was 
placed on Awareness Initiation and Teacher Adoption Preparation.. Most 
activities in these' two clusters were performed, on the average, more 
often than once a month, and some ("Contacting new clients," "Providing 
'detailed information") were performed, on the average, almost weekly.* 
The next two work clusters in terms of frequency of performance (performed 
a little less than once monthly) were Implementation Specifics and (Main- 
taining) Support of Teachers (and other school personnel).** Next, but' 
markedly less in frequency of performance (less than once a month butmore 
than once a year), was Administrator Adoption Preparation. Finally, it 



*Recal 1 that the DESSI sample of agents spent a little more than half 
their time interacting with clients. The remaining time was spent in 
administration, travel, professional development, and other tasks. Of 
the total time spent with clients, half was spent in initiating rela- 
tionships and assisting in adoption preparation. The other half was ' 
spent in helping with practice selection, implementation, and follow-up. 

**We note that the NDN D/Ds were more concerned with Implementation Specif 
ics than were NDN SFs, as might be expected, given individual D/D's con- 
cern with helping clients install the D/D's own specific program. 
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appears that the least amount of effort (averaging somewhat more than 
about once a year, but very much less than once a month), was spent on 
Evaluation or Continuation/Diffusion activities. 

The local IV'-C consultants also spent little effort on Continuation 
Diffusion activities; however, th.ey spent even less effort on Awareness 
Initiation, which was one of the high-effort work clusters for other DESSI 
agents. The three major work clusters for local IV-C agents, in descending 
order of performance, were: Implementation Specifics, Evaluation, and Teach- 
er Adoption Preparation. 

The DESSI study thus provides us with two distinct images of external 
agents. One is the image of the [NDN or state IV-C] Solution Giver; the 
other corresponds more to the technical assistance specialist, e.g., in eval- 
uation or training. The latter group may in fact be more like the RBS/ESA 
[curriculum] Expert/Trainer agent than they are like the [NDN or state IV-C] 
Solution Giver. 



4. Linking R&D With Schools (RDU) T Agents 

Our richest set of information on linking agent work is found in t}<* 
Linking R&D with Schools study and is based on a sample of 53 of the approx- 
imately 100 field agents supported by the seven RDU projects. These persons 
were known as "linking agents," "general i sts," "coordinators," or "facili- 
tators," but all were expected to provide in-person services to schools at 
school sites.* Moreover, these agents were viewed as coordinators of pro- 
cess assistance that schools would need, including orienting school person- 
nel to a rational problem-solving model, assisting them in defining needs, 
selecting appropriate solution(s) in the form of R&D-based or practitioner- 
developed and validated products and practices, and then assisting school 
staff to plan for, and implement, improved curriculum and staff development 
practices. The only responsibility these RDU agents did not have, generally, 
was that of finding exemplary programs. Other RDU project specialists had 
this function. However, these agents were expected to help schools locate 
human resources (e.g., program experts, trainers) who could assist them 
with implementation. (And, as we shall see in Section IV-D, this additional 
assistance obtained by agents was extremely effective.) 

In all cases, the RDU agents were located outside the RDU project 
office in various types of "host organizations" (see Section IV-B, 
Table 8). All the agents were educators, most with recent experiences 
working with school districts, either as consultants or as staff of a 
state education agency or association. However, the employment as RDU 
agents varied enormously, with many (approximately 40%) committing less 
than a fourth of their time to the effort, whereas for others (approximately 
25%) it was nearly or completely a full-time job. For some, it represented 



*Note that this is in marked contrast to the majority of the DESSI External 
Facilitators, who, according to Cox and Havelock (1982, pp. 6-7), were much 
less familiar with specific sites. N 



4.23 



their first professional position after obtaining an advanced degree (all 
but one held advanced degrees; 70% held M.A. 's, 30X held doctorates), whereas 
for others it was their last position prior to retirement. But for most 
ft was a midcareer position. The average age was 41. Slightly over half 
the agents in the sample were male. Three-fourths of the agents had previous 
experience with* other federally funded programs; two-thirds had previous 
experience, with other "linking" roles; but only onethird had previous 
experience with the implementation^ R&D products. 

•What roles did these RDU agents play? Table 10 displays the ranks 
and mean ratings for their repprts of expected and actual performance 
for each of ten roles. At the bottom of Table 10 are three role-speciali- 
zation scales — General Support (GS), Process Expert (PE), and Content 
Expert (CE) that were formed by combining Vole items. Also included 
are two agent-style scales, Reactive Style (IR) and Proactive Style (£), 
that were also formed by recombining some of the role items. Each role 
item is marked to indicate which scale(s) it belonged to. In terms of 
actual performance, two "general support" (GS) roles--Resource Person and 
Coordinator--tied for first place with means equal to 4.2 (on a five-point 
scale); thus most RDU agents must have rated these roles as played to a 
great or very great extent. The next six roles all display mean ratings 
between 3.0 and 3.3, which is probably not a statistically significant 
difference (3.0 = "to some extent"). Two more of the "general support" 
roles--0bserver/Hi storian and Counselor or "Handholder"— are among the 
three roles with mean ratings of 3.3. We thus see that among the five 
highest rated items, in terms of actual reported performance, are all 
four of the items in the General Support Scale. Moreover, all three of 
the Reactive Style items are among these five items. The scale means at 
the bottom of Table 10 indicate that the mean for General Support items 
(3. 75) is significantly higher than the means for Process Expert (2.93) or 
Content Expert (2.87). Also, the Reactive Style mean (3.63) is signify 
cantly higher than the Proactive Style mean (3.13). Among the ten individ- 
ual roles, only the Program Implementor and Evaluator roles were performed 
relatively infrequently. 

These data indicate that RDU field agents saw themselves as playing 
many roles. In average frequency of performance, the General Support roles 
were played much more frequently than either the program change Process Ex- 
pert or the Curriculum Content Expert roles. Moreover, the Reactive Style 
roles were played significantly more often than the Proactive Style roles. 
In terms of individual roles, the RDU agents saw themselves, in their ex- 
pectations and in their general performance, primarily as resource persons 
and coordinators and less often as program implementors or evaluators. How- 
ever, they expected to play, and reported that they did play, six other roles 
"to some extent." Generally, their actual role performance was consistent 
with their expectations, with perhaps one exception: Most agents expected 
to play the role of expert in assessing the match between innovations and 
problems more than they reported that they actually played this role. The 
remarkable points are that most agents tended to play General Support roles 
(as contrasted to the Process Expert or Content Expert roles) and to engage 
in a relatively low-key, reactive role style, rather than a more intrusive, 
proactive style. 




Table 10 . Ranks and Mean Ratings of RDU Field Agents' Expected and 
Actual Extent of Performance of Various RDU Agent Roles 
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5 = to a very great extent 
4 = to a great extent 
3 = to some extent 
2 = to a little extent 
1 = not at all 



As in the RBS/ESA study, the Abt researchers also correlated and fac- 
tor-analyzed the role-rating data. These, results are not reported, but ap- 
parently the Abt researchers also encountered the same type of very low in- 
tercorrelations among roles, since they state, "At this point it should be 
noted that a number of the original questionnaire items, including some 
roles and activities which the average agent performed to a great extent, 
did not load highly on any of the factors . . . and for this reason they 
were not included in the scale" (Louis, Kell, et a1.,,pp. 124-125). In 
fact, the three scales that , we actually formed were composed of only five 
of the original ten items,' as follows: 

Program Change Expert (three items) 

t Expert in assessing the match between innovators and 
problems 

*t Program implementor 

t Evaluator # I 

(Note that this scale combing two a priori Content Expert roles 
with one Process 'Expert Pole. * The scale mean is .2.7, indicating 
that this^factor scale role was. not too frequently performed.) 

Conten t. Expert (one' item) rt 

v 

• Basic skills, career education, or inservice specialist 

^ 

General ist-Coondinator (one item) 
t Coordinator 

• We thus see that half the ten roles showed no appreciable loading on 
any of tf\e three factors. Although neither item correlations nor factor 
loadings were reported, we may assume that much less than half the total 
variance in the set of ten items was extracted. With a reported alpha coef- 
ficient of .75, even the average intercogrel ation among the three items in 
the Program Change Expert scale is only .50. Louis, Kell, et al. (p. 125)' 
note that the only frequently performed role that emerged from this factor 
analysis was General ist-Coordinator. And here the surprising point is that 
apparently none of the other high frequency a priori General Support roles 
(Resource Person, Observer/Historian, Counselor 'or "Hand Holder") showed 
appreciable loadings on any of the three factors. 

Agent activities . The Abt researchers went well beyond the examina- 
tion of global definition work roles. Based on interviews with a sample 
of agents, they generated the list of 16 routine activities displayed in 
Table 11, which RDU field agents were asked to rate in terms of importance 
of the activity and in terms of the amount of time spent. Two activities 
stand out in terms of time spent: Meetings and Writing Reports/Filling Out 
Forms. The next eight activities are within +0.2 of the score 2 (= "a mod- 
erate amount of time"). Scoring, somewhat lower, between 1.5 and 1.7, were 
four additional activities. Finally, two activities, Working with Individ- 

0 



fa ble 11 . Ranks and Mean Ratings of Perceived Importance and Actual 
Amount of Time Spent on Various* RDU Agent Activities 
(N * 43) 
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3 ■ very Important 
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2 " a moderate .amount of time 

1 « little or no time 
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ual Teachers and Working with Parents or Volunteers, received very little 
or none of the agents' time. The importance RDU agents attached to these 
activities tended to mirror the amount of time spent, with perhaps four excep 
tions. In terms of the item rankings,* agents spent much more time writing 
reports and filling out forms that they felt necessary (in part due to 
the RDU project v documentation/eyaluation requirements), and they spent 
much more time traveling from site to site than they might have liked. Con- 
versely, they rated developing themselves professionally as second highest 
importance, but were able to spend relatively less time on this activity, 
and, in like manner, they 'rated reading materials about R&D products as 
more important than the amount of time they spent on this activity. 

These 16 items were also factor-analyzed (detail not reported in pub- 
lished reports) with the result that 11 of the 16 items loaded on these 
four factors: 

(BS) 1. Boundary spanning activities . This scale includes a number 
of activities that are closely associated with traditional 
definitions of the Boundary Spanning role; that is, repre- 
senting one's organization to the outside world and acting 
as the organization's agent of influence over external 
organizations. The items making up this scale are: meeting * 
with small planning groups at the sites, writing reports/ 
filling out forms, traveling from site to site, promoting 
or explaining the 'RDU program, organizing, preparing or 
delivering materials, and meeting with RDU central project 
staff. The standardized alpha for this scale is .78. 
[Average intercorrelation = .37] 

(BM) 2. Budget management . This scale consists of one item: 
managing budgets. 

(AT) 3. Activities with teachers . This scale comprises two items: 
observing teachers and working with individual teachers. 
The standardized alpha for the scale is .73; [r - .57] 

(PD) .4. Professional development . This scale is composed of the 
following items: developing yourself professionally and 
reading aJ)out R&D products. The standardized alpha for 
the scale is .68. [r = .52] 

(Items appearing in these four factor activity scales are 
marked in Table 11 respectively: BS, BM, AT, or PD. 
Items marked with a dash in Table 11 were not included in 
any of the four scales.) 

Table 12 displays the intercorrelations of these role and activity 
scales. Among the three role scales, there is only one significant cor- 
relation. Agents who tended to play a coordinator* role tended not to play 
a content specialist role. The correlation, however, is not large (-.26). 
Among the agent activity scales, there is also only one significant cor- 
relation: /Activities With Teachers showed a small positive correlation 
(♦28) with Boundary Spanning activities, but, with this one exception, 
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Table 12. Intercorrelations of RDU Roles and Activities 
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none of'the activity scales is significantly related to the others. However, 
there^are four statistically significant correlations between the role and 
the activity scales. Agents who played a Coordinator role more frequently 
also tended to perform Boundary Spanning, Budget Management, and Professional 
Development activites more frequently. Boundary Spanning activities are 
also positively associated (.41) with the Program- Change Expert role. 
There is no Significant relationship between the Content Specialist role 
and any of the activity factor scales. 

Table 13 displays the correlations between these RDU agent role and 
activity scales and a selected set of 24 other RDU study measures. The 
following brief 'comments will indentify some of the statistically signif- 
icant relationships. 

Age and teaching experience . ^BDU agents who were younger or less ex- 
peri enceTTtH^Ton^ two variables is .54) performed Co- 
ordinator roles and Boundary Spanning activities significantly more fre- 
quently than did older or more experienced agents. However, older agents* 
tended to play the Content Expert role more often than younger agents. 
There are no other significant relations between age and experience and 
other roles or activities. 

» 

Status in the RDU project . Percentage of- time spent in the RDU role is 
significantly related to only cuie RDU agent scale. Agents who spent most 
of their time in the RDU pole were more likely to perform the Program 
Change Expert role. RDU agents were asked how they saw themselves in re- 
lation to the three main groups they worked with -- the RDU project, the host 
organization, and local site's by graphically indicating where they saw 
themselves in relation to each pair of-groups. Agents who saw themselves 
as not belonging to cither of the organizations in the project/host organ- . 
izatiion or the project/local site pairs were scored high on a Project Mar- 
ginality scale. Agents who saw themselves as not belonging to either or- 
ganization in the local' site/host -organization pair were scored high on 
a Local Marginal ity scale. (These two marginal ity measures are almost in- 
dependent; r = .16.) Agents who scored higher in Project Marginal ity tended 
to play two roles significantly more often: Content Expert and Program 
Change Expert.** Although two corelations involving the Local' Margi nal ity 
measure are nearly as high, the variable Ns for available measures cause ■ 
them not to be statistically significant. Finally, agents who reported 
higher levels of role conflict (e. g. , extent to which agents reported that . 



*More than 30 measures were correlated with these role and activity scales. 
Variables involving training measures or support from local site staff 
that were generally insignificant have been omitted. 

**The more' time the agent spent in RDU, the more marginal he or she felt 
(r = .60). Project marginal ity is also positively related to job satisfac- 
tion (r - .26) and negatively to agent's reported role conflict (r = -.31J. 
Thus, agents who score high on this scale may avoid conflicts and find thei 
jobs more satisfactory by not relating strongly to any of the organizations 
they must work with. * 
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Table 13. Correlations Between RDU Role and Activity 
. Scales and Other- RDtkStudy Variables 





1 1 i — 

, ( 

ROLE SCALES 




A 


CTIVITY 


SCALES 






u 
o 












(/> (/> 


c c 


RDU 


+J 
*o 

,c 


c *j 


Change 






c 

J! 


•r- 0) 

•r- U 
m 


Professic 
Oeveloprm 


STUDY, VARIABLES 

• 


Coord 


Conte 
Exper 


■ 


Bounc 
Spam 


Mana< 


Actr 
w/Tei 


Age 




30* 


-T 


-.28* 


-.17 


-.17 


-.13 


Years teaching 


-.33* 


.16 


-.17 

1 


..52* 


-.17 


-.17 


'.04 


Percent time in RDU 


nn 
• UU 


• lit 


! " 
.2,9* 


1 1 
• ii 


12 


-.11 


.06 


Project marginal ity 


• 18 




.2 




1Q 




-.08 


. 14 


Local marginal Ity 


n 7 

• 07 


. • Uo 


-.2 






- 13 
— . i j 


.05 


.18 


Reported role conflict 


-.22 


.06 


.0 


r 


.27* 


-.10 


.11 


.01 


Change skills . 






.0 




.18 


.17 


-.20 


..18 


Communication skills 




• . i ** 


.. 23 ; 


-.36* 


-.24 


-.24 


.18 


Use-of-power skills 


- 1 0 


-.ll 1 




-.43* 


..10 


-.24 


.10 


Appropriateness of amount of training 


.09 


-.36!* 


;i4 


.00 


-.13 


-.01 


-.24 


Project director's Influence 


-.06 


.21 " 


.23 


.59* 


-.13 


.25* 


.13 


Project evaljator's influence 


-.10 


..04 


.26* 


.28 


-.03 


-.04 


.05 


Supervisor's influence 


28* 

* CO 


l 

.23 


.00 


.43* 


.00 


.04 ' 


.39* 


Site administrator's Influence 


1 fi 


.09 


.07 


.44* 


-.02 


.26* 


.13 


Project dlri^or's support/Interaction 


-.04 


.07 


.31* 


.49* 


-.08 


-.03 


-.03 


Project evaluator's support/interaction 


nri 
• 00 


no 
• Uo 


.33* 


3** 


- 32* 


- 1ft 

— . iO 


-.10* 


Supervisor's support/interaction 


.14 


.08 


.26 


.38* 


-.09 


.10 


.26 


Other field agent's interaction 


-.05 


-.03 


.04 


.21 


.10 


.07 


.21 


District administrator's support/Interaction 


.39* 


-.35* 


.10 


.21 


.01 


.30* 


.03 


Site principal's support/Interaction 


.06 


-.11 


.11 


-.14 


.03 


.10 


-.12 


Sense of efficacy 


..10< 


-.02 


-.05 


-.01 


.00 


-.28* 


-.09 


Job satisfaction 


-.05 


.34* 


.09 


-.01 


.12 


-.05 


-.01 


Perceived program success 


.07 


-.22 


.11 


.03 


.03 


-.02 


.01 


Perceived site performance 


-.03 


-.25 


.03 


-.27* 


-.11 


-.15 


-.04 



'Correlations significant at .05 level marked with asterisk; values differ 
to variable N's. 



people had different opinions about what or how they should be doing their 
jobs) were more likely to be frequently engaged in Boundary Spanning activ- 
ities. Aside from these four significant correlations, there are no strong 
relationships between agent roles and activities and variables relating to 
their status in the RDU Project. 

Skills and training . A factor analysis resulted in the grouping of 
11 (out of- 24) skill<.it?ms into three skill scales: Change Skills, Com- 
munication Skills, and Effective Use-of-Power, Skil Is. The Change Skills 
scale (e.g., sfelf-rated skill in problem identification, solution selec- 
tion, evaluation/follow-up) was _not significantly related to any role or 
activity scale. The Communication Skills scale (i.e., listening and un- 
derstanding, oral communication, interviewing, influencing thorugh con- 
frontation and advocacy methods) displays negative correlations with most 
roles and activities, but the correlation is significant only for Boundary 
Spanning, that leads to the' perhaps strange conclusion that those who more 
often performed Boundary Spanning activites saw themselves less skillful 
in communication. Ef fecti ve-Use-of-Power Skills (i.e., "gaining acceptance 
at all levels of the system, effective use of formal and informal power 
structure, openness to change) is also significantly negatively associated 
with Boundary Spanning.* Agents who reported that they performed Program 
Change Expert roles frequently tended not to perceive themselves as having 
strong Use-of-Power skills. 

Among four measures of RDU training (Amount, Usefulness, Appropriate- 
ness of Amount, Timeliness), only one of these training measures showed a 
significant relation with any of the role or activity measures. Agents who 
performed the Content Expert role more often were much less satisfied with 
the adequacy of the amount of training they received. 

The influence and support of others . The Influence that others had 
on the agent was measured by asking agents to rate the RDU project director, 
project evaluator, fiost organization supervisor, and school site administra- 
tor (principal), as well as others, using a four-point scale ("none" to M a 
great deal") on each of three dimensions (influence on your activities , in- 
fluence on amount of time you allocate, how much feedback received about 
how you are performing your job), which were then summed to form a scale. 
The Support received from others was determined by asking agents to state 
the amount of interaction (face-to-face, telephone, written) they had with 
each person on a five-point scale ( 0 = "never" to 4 = "daily"). Ratings 
for the three modes of interaction were summed to obtain an interaction 
support measure for each person. Perhaps the most remarkable finding in 



*We note, however, that the Communication Skills and Ef fective-Use-of-Power 
Skills scales are very highly intercorrelated (r = .86), and thus, tend to 
display rather similar correlations with other variables. In fact, these 
two scales are so highly correlated that we are surprised that they were 
not combined into one scale: Communication and Use-of-Powor. Viewing 
Communication Skills as very closely associated with Use-of-Power Skills 
may help to understand why the Communications Skills scale is negatively 
correlated with so many roles and activities* 
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this set of correlations of roles/activities with influence and support 
measures is that RDU agents who performed Boundary Spanning activities 
frequently were positively and significantly influenced and supported by 
virtually everyone. As we have seen, Boundary Spanner agents tended to be 
/'younger and less experienced (in teaching), reported greater role conflict in 
iterms of different expectations others had of them, and, in their Boundary 
Spanning activities, spent more traveling time from site to site, meeting 
with small planning groups in the school, promoting or explain ng the program, 
writing reports, preparing or delivering materials, and meeting with project 
staff. In a word, they were "doers." Consequently, we should expect that 
these agents would report much higher levels of interaction with others. It 
is also clear that this interaction produced substantial levels of perceived 
influence of those others on the agent. 

Among the other activity scales, significant correlations are sparse^ 
Agents who engaged in more activities with teachers reported greater influence 
by both the project director and the local site administrator* In addition, 
they reported more support/interactions with school district admiistrators. 
Agents who tended to engage in Budget Management activities were not influenced 
or supported significantly by anyone, excegt negatively (i.e., relatively 
less interaction) with project evaluators. Agents who engaged in more 
personal Professional Development activities reported higher influence by 
their own host agency supervisor. (This, by the way, is virtually the only 
significant correlation for the Professional Development variable aside from 
its low but significant, relation to the Coordinator role. See Table 12.) 

Among the correlations involving the three role scales, Program Change 
Experts seemed more prone to influence by or interaction with the project di- 
rector and the project evaluator. Recall that although agents playing the 
Change Expert role displayed more Project Marginal ity, they also tended to 
spend a .greater portion of their total time working for the RDU project. 

.Frequent interaction between agents and school district administrators is 
apparently much more likely for agents performing a Coordinator, rather than a 
Content Expert , role. We finally note that interaction/support from other 
agents and from site principals seems to have no influence on any of these RDU 

, agent roles or activities. 

Agents' perceptions of outcomes . The last four rows in Table 13 report 
correlations between RDU agent roles/activities and four outcome measures. 
Sense of Efficacy was measured by asking each agent to judge his/ her importance 
to the accomplishments achieved at school sites during each of four phases 
(problem identification, solution selection, planning for implementation, 
implementation). The scores for the four phases were summed. The Job Satis- 
faction scale was the sum of ratings of two items (On the whole, to what extent 
are you satisfied with your job; to what extent [is it] true? [My job] uses 
my skills and abilities and lets me do the things I do best). Perceived Program 
Success reflected the degree to which RDU agents believed that four types of 



*We suspect that this may, in part, be an artifact of differences among 
the seven RDU projects reflecting differences in project organization and 
operations. 



clients (district administrators, site principals, teachers on the 
planning team, teachers not on the teams) felt that the program achieved 
its objectives. The four ratings were summed to produce the Perceived 
Program Success measure. The Perceived Site Performance measure was 
derived by asking each agent to rate a randomly selected site they worked 
wjth on three dimensions (extent the selected solution solved the problem 
identified; extent the solution has been implemented and is likely to con- 
tinue to be used; extent to which the problem-solving process has been incor- 
porated); and also included a measure based on the extent to which the 
agent saw a difference in local site personnel knowledge and skills in 
effective problem solving at the beginning and near the end of the project. 
Perhaps the major finding with respect to these and other agent outcome 
measures is that the agent role and activities scales have very little 
relationship to these outcome measures. There are only three significant 
(P < .05) correlations out of 28 correlations (and at least one would 
be expected due to chance). Content Experts reported higher job satis- 
faction; Boundary Spanners perceived their sites as having performed less 
well; and RDU agents who engaged in more Activities With Teachers reported 
a lower sense of efficacy. 

The Abt researchers have thus provided us with some idea of the fac- 
tors that may influence what linking agents do. Boundary Spanning agents, 
in particular, are influenced by the interpersonal relationship that they 
establish and maintain. To a much lesser degree, other agent roles and 
activities are sometimes affected by interpersonal relationships. 
Other factors influencing especially the Coordinator role and Boundary 
Spanning activities are the agent's age and years of teaching experience. 
Aside from Project Marginality, which related to two roles, status in 
the project, including percentage of time allocated to the RDU role, 
displayed much less influence than might have been expected. Self -reported 
skill levels and training also seemed to have little influence. Finally, 
although Section IV. D below will show that RDU agents 1 involvement 
positively and significantly affected successful school change, there is 
little evidence in Table 13 that specific agent roles or activities have 
a significant relationship with agents' sense of efficacy, job satisfaction, 
or perceptions of site performance or program success at a site. 

5. RBS Local School Improvement Agents 

Although only six agents were involved, the RBS Local School Improve- 
ment (LSI) study adds additional insight regarding school effects on agent 
roles. Summarized briefly, the RBS/LSI reports indicate that several 
school site factors, including scarce resources, interpersonal tensions, 
organizational instability, and Staff expectations operated to force agents 
to expand their roles beyond the original technical roles assigned by RBS. 
Corbett (1981) identified five additional fuctions that were performed: 
expanding the process helping role, process adjusting, (re)endorsement 
seeking, mediating conflicts, and providing clerical services. 



ERIC 



4.34 



154 



6. Summary and Commentary 

What can we conclude from this wealth of data on linking agent work? 
Perhaps, first, that we can no longer complain about a lack of data! 
However, it is equally obvious that we sorely need much better instrumen- 
tation with which to measure appropriate dimensions of linking agent work. 

Here are some technical observations. As we have seen, role labels, 
perhaps because of their ambiguity or perhaps because they indeed label 
relatively unrelated work clusters, tended to be generally weakly related 
to each other and thus provided a 1 ess-than-promisi ng basis for creating 
multi-item scales with high internal consistency coefficients. Conse- 
quently, the scales derived from role items are not highly reliable, a fact 
which, in turn, tends to attenuate the correlations of these scales with 
other measures. This may explain much of the lack of strong relationships 
among work roles and between work roles and other measures. Activity- 
level items tended to work better, perhaps for two major reasons. Usually 
more items were written, and typically a larger number of related items 
appeared in the same instrument. As a result, the factor analyses based 
on activity items extracted more of the total variance, and there were 
usually more items in a scale. 

Finally, given more items and higher correlations among items in 
the same scale, higher internal consistency coefficients result. This, 
in turn, serves to reduce attenuation of correlation between scales. 
Note, for instance, the unusually impressive list of significant correla- 
tions (in Table 13) where a six-item Boundary Spanning activity scale 
was involved. Multiple item scales perhaps serve another useful purpose. 
They help to clarify, sometimes for the respondent, but certainly for 
the researcher and the reader, what the scale measures. Consider the 
one-item RDU scale, General i st-Coordi nator, whose one item is a coord- 
inator"; or the one-item RBS/ESA measure, Monitor, whose one item is 
"Monitor who identifies discrepancies between regulations and practices. 
If either of these scales had even a few other items, we might. have a 
much clearer impression of what the scale measured. 

Perhaps a final technical quibble concerns labeling and interpre- 
tation. This problem is perhaps best seen in the NTS analysis, where 
first the original Butler and Paisley linking agent function labels were 
sometimes grossly simplified or misinterpreted in the writing of item 
examples (e.g., communication items dealt only with communication with 
clients; only one "process helper" item was created), and then the factors 
derived from these items were given overly broad labels (e.g., resource 
finder is concerned almost entirely with information resources; the com- 
muni cation factor is concerned only with client cornmunication). This 
problem also appears in other studies. For example, in the RBS/ESA study, 
the two-item factor scale ("Expert on a curriculum area"; "Workshop Pre- 
senter") became abbreviated to "Expert/Trainer" and then in other places 
to simply "Trainer," and thus the Curriculum Expert concept faded away 
(despite the fact that this role had the highest loading on the "Expert/ 
Trainer" factor). Even the DESSI study that we so admired had its factor 
labeling problems. The Cox and Havelock "Support of Teacher" factor ap- 
pears to include three items that refer to building or maintaining support 
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among school personnel. Most school personnel, of course, are teachers; 
but are all school personnel teachers? So let the reader beware! Scale 
and factor labels may not accurately or precisely convey their content. 

Turning to substantive matters, what may we conclude? Perhaps, first, 
that comparisons among studies are perhaps more easily made in terms of 
differences in descriptions of linking agent work rather than in similar- 
ities. Yes, all were linking agents, but they played quite different roles! 

As we have seen, most of the State Dissemination Grants Program agents 
were school- or district-based, and the majority confined their work to 
"spread" or "exchange" roles rather than assisting their local clients in 
"choice" or "implementation." A great majority appeared to play combina- 
tions of versions of two of Butler and Paisley modal role specializations: 
[information] resource finder and generalist linking agent, "scout ." A 
few of these agents, probably mainly those located in SEAs or ESAs, 
apparently tended to move from these primary roles toward the process 
helper or solution giver roles, but the instrumentation was too fuzzy to 
distinguish between these two modal roles. We are thus left with a 
relatively well-defined "Facilitator" role whose items bear only distant 
resemblances to either a strong Process Helpt-r or a strong Solution Giver 
role. According to the NTS typology, only two of the 136 agents were 
classified as playing a pure Facilitator role, and only three combined 
the Facilitator/Resource Finder roles. However, 27 agents combined the 
Facilitator/Communicator roles, and many of the agents (44 of 136) were f 
"eclectics" who gave roughly equal emphases to all three NTS roles. We 
concluded that the three NTS factors describe the major subdimensions of 
an essentially Information Resource Finder/Client Communicator role. , 
Given the generally large numbers of clients to be served (large scope ), 
the relatively small amount, of time that agents could work with individ- 
ual clients (low intensity ), and the probably limited breadth and depth 
of expertise vis-a-vis client needs, few of the SDGP agents were able to 
carry out more than an Information Use Assistance Strategy. Their entitle- 
ment was quite limited. Unfortunately, the NTS study does not provide much 
information concerning differences in agent behavior according to the type 
of "host organization," so we are unable to confirm hypotheses concerning 
possible agent role differences by type of organization that are strongly 
suggested by the data presented in Table 1. 

When we turn to the Educational Service Agencies, we discover that 
nearly half of all our data describes linking agents who worked in these 
agencies. We see that their work was significantly affected both by 
the type of ESA (e.g., compliance-oriented or service-oriented) and by 
the nature of their sponsorship or entitlement. ESA-based agents associated 
with the SDGP apparently performed primarily information use assistance 
work. Those associated with NDN pr RDU were very heavily involved in Solution 
Giver roles, sometimes with overlays of Process Holper roles, but they 
rarely played Resource Finder roles, except to find other human resources 
who could provide training or other specific forms of technical assistance. 
However, when the agents worked for their own agency (rather than for or 
with federally funded programs such as SDGP, NDN, or RDU), the type of 
agency dominated agent role behavior; i.e., the New Jersey County Office 
agents rarely played a strong [Curriculum] Export/Trainer role, and, 
with a few exceptions, New Jersey EIC agents and Pennsylvania IU agents 
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rarely played a strong Monitoring role* However, the Liaison role, | 
which was played more frequently than either of the other two rolfes, was 
not differentiated by type of ESA agency ♦ The RBS typology (see Table 7) 
indicates that 39X of these ESA agents played som£ type of role fn which 
Liaison activities were quite frequently -performed* . 

The RBS/ESA stucty thus provides us with at least three versions of 
essentially Technical Assistance Strategy roles— the Liaison role appears 
to be similar to the Butler and~Paisley Generalist (Communicator) role 
and may be related to. the RDU study "General i st-Coordi nator" role* The 
[Curriculum] Expert/Trainer role is a clearly but perhaps circumscribed 
variant of the Butler and Paisley Solution Giver role. However, the RBS 
Monitor role involves an entirely new dimension that is mapped not at 
all ,n the Havel ock-Piele-Butler and Paisley conceptualizations* The 
reason, of course, is clear, as Firestone and Wilson (1981, 1982) noted* 
Enforcement is a fundamentally different type of strategy than the rational, 
knowledge-use, assistance' strategies employed in all of other programs 
and projects covered in this synthesis** 

Almost all the DESSI, RDU, and RBS/ LSI agents were obviously Solution 
Givers in the modal sense, but all combined problem-solving process 
help with specific program implementation assistance* Here we perceive 
at least three submodalities: 



1 # The NDN and state IV-C dissemination agents who, according 
to Cox and Havelock (1982, p. 8), spent more than one-fourth 
their time in initiating relationships 'e*g*, holding 
awareness conferences, distributing flyers, etc*)* These 
agents were much more concerned with promoting awareness 
and identifying prospective adopters. Also, they apparently 
were much less concerned with encouraging clients to engage 



*Guba (1967, 1968) was among the first writers in the field of educational 
dissemination to note that at least eight primary change strategies might 
be employed, depending on whether clients were viewed as: (1) value- 
oriented, (2) rational, (3) untrained, (4) psychologically oriented 
(who could be persuaded or conditioned), (5) economically oriented (who 
could be rewarded or deprived), (6) political (who could be influenced 
through power, conflict, and compromise), (7) Bureaucratic (who could be 
compelled), or (8) professionally oriented (who could be obligated)* 
Zaltman, Florio, and Sikorski (1977) identified three basic change strategies 
power strategies, manipulative strategies, and rational strategies. The 
enforcement strategies followed (primarily) by the New Jersey County Office 
agents are obviously power strategies, since they involve the threat or 
use of reward and punishments. In the Guba typology, they fall closest 
to the Bureaucratic clients who can be compelled* Note that, by design, 
threat of enforcement may create motivation for New Jersey schools to. 
turn to the EICs for other forms of technical assistance* The final : 
point to note echoes Karen Louis in her observation that most research 
on« linking agents has been narrowly focused* However, linking agentS fi 
by definition and in actual .practice, use fundamentally rational strategy* 
We should not forget that there are other strategies, but we should also 
not be surprized if distinctly and fundamentally different strategics ' fc 
also entail distinctly different agent behavior. 




in extensive problem definition and solution search processes 
than were the RDU or RBS/LSI agents. Compared to RDU or 
LSI agents, these DESSI agents generally were confronted 
with the need to deal with more clients (higher scope ) and 
thus were not usually able to provide as much intensive, 
on-site assistance (lower intensity )* 

2. The complete Problem-Solving Process/Solution Giver Gener - 
al ists . In terms of strategy and tactics, the LSI agent i s 
best seen as a variant, or certainly a derivative of the gen- 
eric RDU approach. All seven RDU project agents and the LSI 
agents were heavily committed to a systematic problem-solving 
process approach, which sought to link school problems with 
potential R&D-based solutions. These were low scope , high 
intensity agents, who performed many roles * 

3. The Consultant/Trainer Specialists . These were the DESSI 
study local IV-C agents. The RDU program also made exten- 
sive use of specialists, as, noted in Section II. B. and 
again in Section II I. C; however, thesfe agents were not 
'studied in much detail. We have only the brief information 
provided by Cox and Havelock (1982) concerning local IV-C 
agents, and that provided by Firestone and Wilson (January 
1982; June 1982), concerning the ESA [Curriculum] Export/ 
Trainers. The DESSI data indicated that these consultant 
trainers were most heavily involved in providing training 
and technical assistance during implementation, in conducting 
evaluations, and in providing training or assistance in 
teacher adoption preparation. 

With the exception of the sometimes highly specialized work performed 
by specialists in the third group (e.g., conducting evaluations), most of 
these linking agents engaged in, a very broad.range of roles and activities.,^ 
Between the DESSI and the RDU studies, 14 work factors were identified, whereas 
only three factors were identified in each of the SDGP or RBS/ESA studies. 

The complete set of factor analysis factor labels are listed in Table 14. 

In an effort to make some sense out of the serial list of factors pre- 
sented in Table 14, we went back to review the items that loaded on each fac- 
tor. On the basis of this review, we offer Table 15 as our effort to synthe- 
size these factor analysis results. Our interpretation suggests that perhaps 
sjix highly generic clusters are represented in the results of these studies. 

The first cluster is represented by activities and roles which are con- 
cerned with general communication, liaison, coordination, and boundary-span- 
ning. We see the DESSI Awareness Initiation factor as a highly specialized, 
but sometimes extremely important, aspect of this more general role. This 
role/activity cluster may be compared with Havelock's "Catalyst" or Butler 
and Paisley's Generalist/Scout (see Figure 3). 

n The second cluster is the resource finder. It is represented in the 
NTS study with a strong sense of retrieving information resources. The 
RBS Liaison factor contained three items, one of whicn was resource finder, 
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Table 14. 



Strategies and Associated Linking Agent Work Factors 



STRATEGY 


STUDY 


LINKING AGENTS WORK FACTOR 


I. Information 
Use 

Assistance 


NTS/SDGP 


(Functions) 1. Communicator [with clients] 

2. [Information] Resource Finder 

3. [Knowledge use] Facilitator 


II. Technical 
Assistance 


RBS/ESA 


(Roles) * 1. Liaison [planner, coordinator] 

2. [Curriculum] Expert/Trainer 

3. Monitor 


III. Problem- 
Solving/ 
Program 
Implemen- 
tation 


DESSI . 


(Pre-imple- 1. Awareness Initiation 
mentation 2. Administrator Adoption Pre- 
activities) < paration 

3. Teacher Adaption Preparation 

4. Support of Teachers [and 
others] 


(Post-imple- 5. Implementation Specifics 
mentation 6. Evaluation 
activities) 7. Continuation/Diffusion 


Abt/RDU 


(Roles) 1. GeneraTi st-Coordi nator 
c m program i*nange expert 
3. Content Expert 


(Activities) 1. Boundary Spanning 

2. Activities with Teachers 

3. Budget Management 

4. [Personal] Professional Devel- 
opment . 



. , 0 ' 



ERIC 
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Table 15 . Strategies and Associated Linking Agent Work Factors (Tactics) 
~ , Grouped in Terms of Similarity of Work Performed 



INFORMATION USE 
ASSISTANCE (NTS) 
STRATEGIES 


TECHNICAL ASSISTANCE ' 
(RBS/ESA) 
STRATEGIES 


PROBLEM-SOLVING/ 
PROGRAM IMPLEMENTATION 
STRATEGIES 


1. Communicator 


Liaison [Coordinator, 
Needs Assessor/Planner] 


General i st-Coordi nator 
(RDU Role) 

• Boundary-Spanning (RDU) 

• Awareness Initiation (DESSI) 


2. [Information] 
Rp^nurrp Finder 


Liaison [Resource 
Finder] 


[performed by other special- 
ists in the programs] 


3. Facilitator 
[Diffuse KU by 
Individuals] 






4. 


[Curriculum] Expert 
Trainer 


Content Specialist (RDU Role) 
• Implementation Specifics 


5. Favi i itator 
[assist clients- 

■fn "i net* 1 a 

new procedure] 


*> 


Program Change Expert (RDU 
Role) 

• Administrator for Adoption 
Preparation (DESSI) 

• Teacher Adoption Prepara- 
tion (DESSI) 

• Support of Teachers (DESSI) 

• Activities with Teacher 
(RDU) 

• Evaluation (DESSI) 

« Continuation Diffusion 
(DESSI) , . 


6. 




[Miscellaneous] 
t Budget Management (RDU) 
• [Personal] Professional 
Development (RDU) 


7. 


Monitor 


[Evaluation?? (DESSI)] 



ERIC 
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hence this factor is spread between the first two major work clusters. In 
the various programs employing Problem-Solving/Program Implementation Tactics 
(DESSI, RDU, LSI), technical resource finding was typically performed by others. 

We have placed the NTS [Knowledge Use] Facilitator in a separate cluster. 
To some degree it bears a resemblance to the next two clusters, but this re- 
semblance depends more on the factor label than the item content. Among the 
four items in this scale (Planning, Influencing, Producing, Implementing), 
only one ~- "Implementing—assisting clients to install a new procedure 11 — . 
begins to suggest a more intensive form of assistance or implementation. 
We recall that in Section II-B, Michael Fullan made a distinction between 
knowledge utilization (KU) that refered to use of specific projects or pro- 
grams and KU that re'fered to more diffuse use. He aiso distinguished be- 
tween KU by individual users and KU by groups of users such as a school. 
These two distinctions made by Fullan are particularly useful here. We 
are suggesting that the NTS Facilitator cluster best described the linking 
agent work that is concerned primarily with the use of diffuse forms of 
knowledge (e.g., facts, concepts, ideas, curriculum materials, teachers 1 
guides, speeches, reports) by individuals.' This type of assistance appears 
to call for a set of linking agent tactics different from those employed 
when more specific KU (e.g., program adoption/implementation) is attempted 
or when groups rather than individuals are the clients. 

These latter KU objectives characterize the fourth and fifth clusters, 
which differ immensely in the breadth versus depth of agent expertise re- 
quired. The fourth cluster combines perhaps three associated roles: Curric- 
ulum Expert (in some areas such as reading, bilingual education, career 
education), Workshop Presenter/Trainet*, and Technical Assistant. Some 
variant of this set of activities was found in three of the four studies. 
It appeared as the [curriculum] Expert/Trainer in the RBS/ESA stucjy, as the 
Content Expert role irr the RDU study, and as the Implementation Specifics 
factor in the DESSI study. 

Factors in the fifth work cluster are primarily found in programs that 
involved Problem-Sol ving/Program-Implementation strategies. The RbU stucjy 
identified the role generically* as a Program Change Expert. Also, the NTS 
study included one item, Facilitator— assist clients to install a new pro- 
cedure.-* The DESSI study factor analysis unpacked this pole into at 
least five components.** Note that, although we have grouped all these 



* The NDN Technical Assistance Base contractors did much of the resource 
finding, cataloguing of JDRP approved programs, and provision of training 
and technical assistance for NDN SFs and D/Ds. In RDU, each project 
employed information and training specialists; in LSI, the- program developers 
at RBS played the resources-finding role. Some of the .agents in the 
programs did look for human resources, but this type of activity was not 
explicitly identified in any of the items. Implicitly, it tended to be 
subsumed under boundary spanning, liaison, or coordination. 

**The DESSI Implementation Specific Component was placed in the fourth work 
cluster. A seventh DESSI component, Awareness Initiation, simply wasn't 
a large part of RDU agent work. Although it was an important first step 
in program implementation, especially for NDN agents, we have placed 
this component in the first work cluster with communication, liaison, 

* coordination, and boundary spanning activities. 
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these components under this one generic role, each emerged as a fairly 
independent and distinguishable factor. 

The sixth cluster is a miscellaneous "catch-all" in which we have 
placed two RDU activity factors: Budget Management and [Personal] Pro-r 
fessional Development. We recall that Cox and Havel ock found that, in 
their study of DESSI agents, the sample as a whole spent only a little 
more than half their time with clients, and that the other half was "spent 
on routine maintenance tasks associated with their roles (administration, 
professional development, travel, and in-house product development)" (Cox 
and Havelock; 1982, p. 7). Because these types of activities did not deal 
directly with clients, they weren't considered in the DESS* analysis. The 
RDU study included several items of this type (e.g., writing reports/filling 
out forms; traveling from site to site)., but the two factors listed in 
Table 15 are the only factors that emerged. This sixth cluster stands as 
a now nearly empty place-holder for a broad array of administrative, 
financial, maintenance, housekeeping, self-development, and other functions 
that have been largely ignored in the analysis of linking agent work. 

At the bottom of the tables we have placed- the one RBS/ESA Monitor 
factor. As we have noted elsewhere, we question whether this one-item fac- 
tor, at least in its pure form, belongs within the set of "rational" 
strategies listed in Table 15. However, Firestone and Wilson made it clear 
that many monitor agents did blend Monitoring with Liaison or (curriculum) 
Expert/Trainer roles.* As we have indicated in Table 15, perhaps its closest, 
but still distant, counterpart would be the Evaluation factor found in the 
DESSI study. Had the NTS study used the full set of 15 Butler and Paisley 
items, we might have also found some distant counterpart to the highly gen- 
eric concept of monitoring/evaluation in the left hand bottom row of Table 
15. Unfortunately, the NTS sU.^ omitted the two perhaps relevant functions, 
Monitoring Products and Evaluating. "Monitoring Ideas" — keeping abreast 
of recent education practices and innovation — was included. However, 
„this is much more of a professional awareness or vigilance-type item. 

This item, by the way, was one of two items; the other was "Intervening- 
Proactively seeking clients needs" which displayed appreciable loadings 
on all three NTS factors. Other analyses also found "multifactor" items 
that loaded, to an appreciable extent, on two or more factors and thus 
were not included in any scale. Examples are the RBS/ESA Proposal Writer 
role which loaded in the .4 range on both the [curriculum] Expert/ Trainer 
and the Monitor factors. In the DESSI study, "putting out fires" and 
"assessing needs" were two multifactrr items. We suspect that the Abt 
researchers also found such items, but none were reported. Although 
items of this type tend to get lost when creating item scales, we need 
to attend to them more closely when looking at the meaning of the factors, 
as contrasted to the item scales created by using the factor analysis re- 
sults as a guide to item clustering. For example, assessing needs or 
monitoring ideas are undoubtedly important pafts of several work 



*Their typology (see Table 7) indicates that the combined percentage 
of "Monitor-Trainer," "Monitor-Liaison," and "Monitor-Trainer-Liaison" 
types'(17%) exceeded the percentages of the "Monitor Only" type (14%). 
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clusters. Eliminating the effect of suc^ items in creating derived mea- 
sures is unnecessary and perhaps unwise.* 

Perhaps our final reminder with respect to Unking agent work clusters 
is that some of v these analyses simply "lost" items. In 'instances such as 
the DESSI library and computer search item or the RBS/ESA curriculum designer 
or group process trainer items, that occured it was because very few 
agents performed this type of work. However, in other cases, even among 
high-frequency items, it simply happened that only one item was present 
•in the list to represent a perhaps distinctly different type of linking 
agent activity. With no other related items, the potential' "factor" was 
lost because it was inadequately defined. Examples are the RBS/ESA 
"on-call consultant," the NTS "managing confl i ct — helping others resolve 
discord," or the RDU role items, "Resource Person," "Process Trainer," 
"Observer/Historian," "Counselor or 'Hand-Holder' , n and "Conflict Resolver." 
*It is perhaps truly remarkable tfiat NTS dropped its Managing Conflict ' 
item, Abt dropped its Conflict Resolver item, arid DESSI omitted its 
Putting Out Fires item (because it loaded'on several factors). This 
comment leads to a last question: Where is the modal "Process Helper" 
role defined in Table 15? Is it implicitly part of the fifth work 
cluster? Or is this fifth cluster a definition of the "Solution Giver"?" 
Or is it both? Our answer to this question is to note the label of the 
strategy under which nearly all the factors pertaining to this fifth, 
work cluster are located. It is a strategy that combines Problem Solving 
Process Assistance with Program Implementation (Solution Giving) Assistance. 

We failed to find a true process helper for two reasons. First, and 
primarily, because none of the dissemination programs that were studied 
employed anything approaching a pure process helper strategy. We must look 
to the Organizational Development (OD) literature to find agents in this 
type of role (see Schmuck and Miles, 1971; Miles, Fullan & Taylors 1978; 
Miles, Sullivan, Gold, Taylor, Sieber & Wilder, 1978; Fullan, MiWs & 
Taylor, 1980). Second, as we have seen, too few items were included in 
the instruments of these various studies to clearly identify such a factor, 
even if some of the agents performed this modal role to some extent. 
In the NDN, RDU, and LSI efforts, process was important in both its 
technical and its interpersonal forms, However, as illustrated in Corbett ! s 
(198i) discussion of the "Mediating" roles that emerged as LSI agents at- 
tempted to maintain relationships with schools in order_to carry out their 
technical roles, processing helping was nearly always instrumental for ac- 
complishing what was primarily a highly focused and reasonably sophisti- 
cated form of technical' , problem-solving. process-oriented Solution Giving. 

One final point must be made as we attempt to reconcile these findings 
with the Havelock, Piele, Butler-Paisley theoretical conceptions of linking 



*Gj'Ven the ease of computing factor scores for eacn subject on most com- 
puter 'factor analysts programs, it is somewhat surprising that none of 
these studies employed factor scores, as contrasted to item scales, in their 
analyses. Factor scores would often have preserved more, complete 
measurement of the "underlyi ng trait. They would also have reduced 
intersect correlations to zero (with principal component factor analyses 
followed by varimax rotations), increased the reliabilities of the 
measures, and reduced the attenuation of correlations with other variables. 
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agent roles. It is simply that, with the exception of the pronounced lack 
of a greater prominance of the Process Helper role, the factors listed 
in the right-hand column of Table 15 may, in fact, represent our closest 
empirically based approximation to the "Superlinker" role (see Figure 3). 
In 1978, ilood and Cates referred to this role as a theoretical construct, 
and perhaps as a worthy goal, but an "impossible dream" for all but a few 
agents who have acquired ttie requisite depth of training and experience 
and have stayed alive (funded) and, committed. The "Superlinker" may 
remain an elusive role for any one. person in reality. But the combinatiop, 
of SF and 0/D agents in the NDN prograrti and the combination of project 
resource specialists, ffeld agent "facilitating/generalists," and training 
specialists that were employed in many of the RDU projects indicate that 
the practical alternative to the "superl inker," -through the arti'culatioh 
of differentiated roles (see Butler & Paisley, 1978, pp. 41-43), has 
•already been achieved and is now documented in at least one version. 
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D. Linking Agent Effects and Outcomes 



1. The NTS and RBS Study Findings 

The NTS Study of State Dissemination Grants Program (SDGP) explicitly 
excluded examination of the effects of SDGP agents on clients* The RBS 
Study of Educational Service Agencies (ESA)was still in progress when this 
section was prepared. Through telephone conversations with the RBS research- 
ers, we learned that they are preparing a report describing benefits, as 
perceived by an informant in each of 68 LEAs, accruing to the LEA as a re- 
sult of working with an ESA. Much, but not all, of their data on perceived 
benefits deals with the ESA agency as age nt (see the Karen Louis discussion 
of agencies as agents in Section 1KB. ) rather than specific ESA personnel 
as agents. The RBS researchers did not believe that they would be able to 
associate the different linker types (trainer, monitor, liaison, and com- 
binations) with LEA benefits because of the number of agents dealing with 
each LEA, but they would possibly be able to associate agency types with 
benefits.** 

The RBS Local School Improvement findings, reported in Firestone and 
Corbett (1981), were confined primarily to examination of two intermediate 
outcome measures: (1) the local school team's progress through the steps 
of the RBS component approaches, and (2) the team's sense of ownership.*** 
These two outcomes were related to (a) school factors (central office sup- 
port; principal's problem-solving motivation; teachers' problem solving 
motivation), (b) agency-school relationship (RBS-school tension), and (c) 
linker behavior (frequency of contact with sites;, range of site personnel 
contacted). The data were based on a study of 11 teams (one team included 
three schools). 



* For outcome data on the effect of agents employing the Information Use 
Assistance Strategies, one must turn to the study of the effects of the 
seven agents in the Pilot State Dissemination Program (Sieber, Louis & 
Metzger, 1972; Lou-is 4 Sieber, 1979) or to occasional evaluations performed 
by individual SDGP projects. 

**The RBS researchers said tttat their preliminary analysis of benefits 
suggested that there were two major classes:. (1) benefits that enabled 
the LEA to better deal with it* external environment (e.g., understanding 
and complying with state and federal law; assistance in presenting issues 
to school boards; help in planning community relations programs); and (2) 
benefits that improved internal LEA organization and instruction (e.g., 
improved administrator skills, better organization and use of school support 
services, cooperative arrangements that produced economies of scale, and 
many different benefits for instruction, including help in planning and 
evaluation of new programs, assistance in implementation and articulation 
f of major curriculum changes, improved teacher skills, improved student 
test socres, Increased staff morale, and improved student attitudes). 

***A third outcome, continuation of LSI changes and several additional meas- 
ures -or local conditions are described in Corbett, Dawson, and Firestone, 
1982. This report suggests that' local conditions are the primary factors 
affecting continuations; no data associating linker behavior or agency-school 
relationships to continuation are presented. 
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Team progress . Five of the 11 teams were rated as going through the 
RBS school improvement steps well, as judged by three criteria (timeliness 
of the process; the team's understanding of the approach; and the team's 
ability to apply the approach to its own problems). Five of the taams 
went through the steps moderately well. One team was rated as poor. 

There was relationship between frequency of linker contact and 
the team's progress. There also was no relationship between the range 
of linker contacts at the site and the team's progress. However, there 
was an almost perfect negative relationship between RBS-team tension and 
progress (only one of f-di agonal case in the bivariate scatter plot). The 
central office support measure also displayed a perfect correlation, but 
this relationship was positive . Moreover, both the teachers' and princi- 
pal's problem-solving motivations were positively associated with team pro- 
gress, but the relationship was statistically significant only for the cor- 
relation involving teacher motivation (r = .66). 

Team's sense of ownership . The findings for the sense of ownership 
outcome variable are almost identical to those fpund for team progress. 
Frequency' of linker contact and range of linker contact showed virtually 
zero correlations with team's sense of ownership. RBS-team tension was 
strongly and significantly negatively related (- :78) to ownership. 
Teacher problem-solving motivation was strongly and significantly positively 
related to team ownership (.67), as was central office support (r = .78); 
Principal problem-solving motivation displayed an appreciably lower 
relationship (r = .35). 

We see that tensions between the RBS development component person- 
nel and the site strongly inhibited the team's progress and diminished its 
sense of ownership. Firestone and Corbett note that linkers were helpful 
here precisely because they could act as mediators between the RBS devel- 
opment staffs and the school sites, and that linkers' skills in mediating, 
both between -RBS =*nd the sites and among individuals or group within sites, 
were perhaps their most useful roles. However, the school factors had a 
substantial impact on the outcome measures. There was a perfect positive 
relationship (no off-diagonal cases) between school district central office 
support (note IfFat these were the "internal" linking agents) and team 
progress. Central office support also shows a strong relation to team's 
sense of ownership (r = .78). The teacher's problem-solving motivation also 
positively and significantly affected both team progress and senSe of 
ownership. Although positive in direction, the principal's problem-solving 
motivation showed no significant association withueither outcome measure. 
Regarding these findings, Firestone and Corbett concluded: 



*Both variables were based on three-point scales. Correction for the use 
of widespread categories would raise the correlation. However, the un- 
corrected correlation is significant even with N = 11, since the critical 
value for a one-tail test that the correlation is not zero is .521. 
Firestone and Corbett (1981) displayed scatter plots for the variables, but 
reported no measure of association nor significance tests of the associa- 
tions. We have computed the product momement correlations to make these 
results comparable to those reported in the other studies. 



4.46 




The above findings suggest that there were no linker be 
haviors that had as uniform an effect on the outcomes 
of team deliberations as the team's own motivation and 
the support of central offi6e staff. Moreover, as al- 
ready discussed, linker behaviors were often responses 
to local conditions rather than proactive interven- 
tions. 

Linkers were useful . . . They mediated between the 
elements of the approaches that were designed in an ex- 
ternal agency and the conditions and beliefs current 
at the school. They were crucial for navigating the 
hazards of a particular site and assuring, that the 
[RBS] approach was of some use. (op. cit. , pp. 14, 25) 



2. The DESSI and Linking R&D With Schools Outcome Models 

Although the RBS studies now available provide only limited infor- 
mation on linking agent effects, quite the opposite is true for the DESSI 
and Linking R&D With Schools (RDU) studies. Both provide extensive find- 
ings. A remarkable aspect of both studies is that they employed two 
levels of analysis, one focusing on the effects of linking agents on 
individuals and the other examining effects of agents on schools as 
organizations. Moreover, both studies examined the effects of linking 
agents in the context of a much wider set of other influencing factors 
and in terms of multiple measures of outcomes. The results in both ( 
studies are thus complex, but highly informative. Technically, both, 
studies encountered serious problems with missing data for various measures 
that sometimes appreciably reduced the number of cases on which relation- 
ships could be measured; however, despite these problems, many significant 
relationships were established.* 

The methods of analysis in the two studies differed. In the Abt study 
of RDU projects, the results were reported as zero-order product moment cor 
relations among variables, and in terms of linear regression coefficients 
and multiple correlations, in which sets of predictor variables were 
regressed (either as a set, or with step-wise entry) against selected 
criteria. The DESSI team also began with correlation of variables 
(as yet unreported) and it appears that they' employed regression models 
that produced multiple correlation estimates for the. effect of selected 



* For complete technical descriptions of these problems and their solu- 
tions, see A. M. Huberman and D. P. Crandall, "Fitting Words to Numbers— 
Multi site Multimethod Research in Education Dissemination" (regarding 
DESSI) and K. S. Louis, "Sociologist as Sleuth--Integrating Methods in 
the RDU Stucty," both i>n American Behavioral Scientist ,- Vol* 26(j.), 
September-October, 1982. 

**As we have noted previously, connonical correlation analysis was also 
employed by the Abt researchers to test tor relationships between mul- 
tiple predictors and multiple criteria. 



predictor measures on selected criteria in their individual effects 
models. However they employed structural equation models involving path 
coefficients to estimate and test for significance of relationships 
among predictors and criterion variables in theif school-focused model. 
Although we have fairly complete reporting of results, including tables 
of correlations and regression coefficients for the RDU study, the 
DESSI results are based entirely on AERA Annual Meeting presentation 
papers which depict only the final models, report the multiple correlations, 
and identify the statistically significant regression or path coefficients, 
but do not report their values. 

When the two studies are examined more closely, we find that each study 
produced at least three levels or types of data relationship models, but 
there are problems in making comparisons. The Abt study of RDU reported 
outcome effects in terms of: 

1. Effects of the RDU program on individuals. 

2. Effects of RDU on school-level Knowledge Utilization/Imple- 
mentation (i.e., scope of solution adoption and implementa- 
tion, degree of product incorporation, and degree of prob- 
lem resolution). 

3. Effects of RDU on school-level School Improvement/Gapaci ty 
Building (i-e. , staff development and development of organi- 
zational problem-solving capacity). 

The DESSI study also presents results for three different data models: 



*Although a gr^ss oversimplification, the primary difference between these 
two approaches lies in the fact that the exact model of the relationship 
'among all variables, predictors and criteria must be specified in a 
structural equation analysis, whereas no specification (other than selec- 
ting the set of variables, deciding on the order they are to enter the 
regression solution, and decing when to stop entering or removing variables) 
is required in multiple regression analysis. Multiple regre Mon results 
produce estimates of the joint , direct effect of all predictc variables 
involved in the regression solution. However, structural equation models 
may specify relatively complex relationships of effects of variables along 
* both direct and indirect paths (expressed as path coefficients) to other 
variables. For example, A, B, and C may affect D, but ony B and C direct- 
ly affect D, and the effect of A is only thorugh B's effect on D (the direct, 
indirect, and combined effects of all three variables on D may be esti- 
mated). Structural equation models thus may produce far more specific and 
interpretable analyses if relationships among 4 variables are at all complex. 
However, the use of more than two or three predictor variables in either 
approach can often lead to very particular results. The values of the re- 
gression coefficients or of the path coefficients may be greatly altered 
if even one variable is added or deleted. With small-size samples, the 
results may not be very reliable (repl icable)* 
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. 1. An individually focused .model for effects on individual 

teachers for whom tjie innovation implementation required a 
minor change in their instructional procedures; 

2. An individually focused model for effects on individual 
teachers for whom the innovation implementation required a 
major change in their instructional procedures; and 

3. A school-focused model of outcomes.. 

It should be noted that the first type of Abt/RDU finding and the 
first two DESSI models treated individuals as the unit of analysis, whereas 
the second ana third type of Abt/RDU findings, but only the thirdDESSI 
model treated the school as the unit of analysis. The DESSI School-Fo- 
cused model combined all school-level predictors and outcomes in one com- 
plex model. The perhaps remarkable aspect of this model is that two 
fairly independent patterns of relations among variables were depicted. 
One related predictors to instruction and practice-related mastery by 
teachers, perceived personal benefits for teachers and others, and prob- 
lem resolution. A second' pattern related predictors to organiza- 
tional change benefits and institutionalization of the practice. At 
first, we thought that these two patterns might correspond, at least 
roughly, to the two Abt/RDU school-level models for KU/ implementation 
and .school improvement/capacity building. There is a relationship, but 
it is not simple. Fundamentally, both the patterns in the DESSI school- 
focused model are perhaps best seen as an elaboration of the Abt/RDU 
KU/Implementation model, since this later model was concerned with scope 
of implementation, product incorporation (institutionalization), and 
resolution of the problem. However, at least some components of the 
two major outcomes appearing in the Abt/RDU School Improvement/Capacity 
Building Model, which focused on organizational development and staff 
development outcomes, are found in the DESSI model, but they were split 
between the two patterns.* However, the systematic problem-sol ving 
process incorporation aspect of organizational development outcomes, 



*Staff development benefits, as defined in, the RDU study, appeared as 
personal gains/losses associated with the practice-related part of the 
DESSI model. Organizational change, which affected more than individ- 
ual teachers \or. students, i.e., organizational development* benefits as 
defined in the RDU study, were the "organizati onal change" benefits 
variable in the organizational change and institutionalization part of 
the DESSI model. The distribution of these organizational change benefits 
as reported by 104 DESSI study school principals included changes in 
the following categories: instructional methods (29%); staff socio- 
emotional state (22%); external communication (18%); staff skills (16%); 
materials (11%); plans/schedules/organization (10%); communication 
(9%); increased staff (8%); and assessment (7%) (Cox & Havelock, 1981, 
p. 16). 
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which was a significant aspect in RDU, was represented in DESSI not as an 
outcome, but only as a single contextual variable.* 

Moreover, there was a major difference in the emphasis on individuals 
as units of analysis and schools as units of analysis in the two studies. 
In the Abt/RDU study,, the treatment of individual data was relatively brief; 
most of the analysis focused on the school-level analysis. Virtually the 
reverse was true of the DESSI analysis. Why this difference? We believe 
that it was not due solely to (real) disciplinary and methodological biases 
of the researchers, but also to fundamental differences between the 
programs they were studying and the types of questions they were attempting 
to answer. By design, the RDU Program was concerned with creating problem- 
sol ving teams at schools who would, with external asistance, undertake a 
relatively well-defined, team-based, problem-solving process, leading to 
the definition of a major problem, to search for and selection of an 
appropriate solution, and then to-planning for, and actual implementation 
of, the selected solution. These solutions often were major curriculum 
changes involving many— perhaps all— teachers at several grade levels. 
Hence, the problem-solving/implementation team was the decision-making 
and action unit, and schools as organizations were the direct beneficiaries* 
The Abt researchers looked at individual responses of teachers and 
school principals, but quickly turned to aggregating teacher responses 
and scaling variables to proceed with school-level analyses. 

DESSI proceeded from a far different set of program assumptions. In 
all four programs (NDN, state IV-C, local IV-C, and BEH), individual 
teachers could, in fact, be the program adopters (or developers in the 
case of local IV-C projects). There was no spec.fic requirement in 
any of these dissemination programs that planning implementation teams 
be formed or that adopters engage in extensive team-based problem- 
solving processes. Team formation might happen because the specific 
characteristics of a selected innovation, but it would be atypical. 
Hence, understanding th* factors that affect an individual teacher's 
implementation of new curricular or instructional practices and the 
benefits that thus derived, became. the primary concern of the DESSI 
researchers. Indeed, they s'tated, "Our Study began with the beTief that 
teachers were central" (Crandall, Bauchner, Loucks & Schmidt, 1982). 
Though their main concern lay with understanding implementation and 
outcomes at the individual teacher level, the DESSI researchers recognized 
that longlasting effects would be achieved only if the implementation 
efforts went beyond individual classrooms; hence they also created a 



*Defiped as Proactive problem-solving , i.e., "the conduciveness of the en- 
vironment to problem-solving, as indicated by the extent to which faculty 
agree that procedures exist for dealing with problems, that decisions 
are made by people possessing adequate and accurate information, and 
that decisions, once made, carry clear action 'implications." This vari- 
able displayed a path coefficient of borderline significance (P-level 
between .05 and .10), as an antecedent to a measure of help received 
from the principal, which in turn'is marginal ly antecedent to practice- 
related mastery,. 
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complementary school-focused model to explore the factors influencing 
organizational change (nonindividual benefits, plans for continuation, 
and institutionalization), o 



We thus see that, although -both studies examined both individual'°and 
organizational level outcomes, their emphases were substantially differ- 
ent, because the dissemination programs they were studying were different. 



3. Other Differences Between the RDU and DESSI Studies 

There are two other nontrivial differences between RDU and OESSI that 
should be noted. The DESSI stucty selected school sites that were known 
adopters of the programs being studied. This selection has two indications. 
First, with the exception of local IV-C sites, all the innovations studied 
were, by definition, "validated" (either by JDR7>7~in the case of NDN; by 
BEH for its products; or by state-run IVD processes for state IV-C projects) 
Second, data concerning sites was usual ly obtained only late 
in the innovation/implementation stage. Moreover, with the exception of 
12 DESSI case study sites, data concerning sites were obtained primarily 
during one short visit to each site. In the RDU study, sites were selected 
before adoptions took place. Indeed, in virtually all cases, sites were 
encouraged to undertake extensive problem definition effort before selecting 
a solution (although not all did so). Also, in many cases the selected 
solution was neither an R&D based nor a practitioner-developed and validated 
product.* Hence, although the RDU program encouraged schools to adopt 
R&D-based or validated practitioner-developed products, the data on 
product quality characteristics were far more variable (and extensive) 
than those for DESSI. Finally, the RDU data were much mere longitudinal 
in character than most of the DESSI data. For at least the 90 RDU Consoli- 
dated Coding Form sites, there were a series, of project records, linking 
agent contact reports, site progress reports, project evaluation reports, 
case study site visit reports, and survey questionnaire data that covered 
as much as two or three years of the RDU site history. Therefore, the 
RDU study findings were substantially more longitudinal, process-oriented, 
and organizational fy oriented (rather than individually oriented), and 
they provided substantially more "fine-grain" information about context, 
product, process, and linking agent characteristics and the, i nterrelations 
of variables than is currently available from the informal, interim 
DESSI reports. 

With aY\_ these differences, is there anything that can be compared? 
We think so. 



*See Yin, Gwaltney, and Louis (1980), who reported that, by the Spring of 
1979, nearly three years after the initiation of RDU and as much as two 
school years into the program for some sites, as many as 62 percent of 
the 194 adoptions they had identified were not known to have been val- 
idated; eight percent were validated NIE catalog products; and 24 per- 
cent were validated NDN catalog products. The remaining products were 

N locally validated. 
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4. A Comparison of Significant RDU and DESSI Findings 

Given the complexity and detail of the findings of the two studies, 
a complete comparison of many specific models and findings would be dif- 
ficult, if not tedious .and bewildering. We shall therefore confine this 
section to a brief summary of the most significant findings of both 
studies* 

Significant RDU study findings . The Abt researchers distilled their 
conclusions to the following points: 

The RDU projects created two types of outcomes: Knowledge 
Utilization/Implementation and School Improvement/Capacity 
Building. 

Engaging in a broad knowledge utilization activity is one of 
the most effective moans of building capacity. 

Good products produced good school outcomes. Validated prod- 
ucts tend to require more extensive individual change. Prod- 
ucts that were perceived by staff to be of high quality and 
relevant to their needs positively affected major knowledge- 
use outcomes (i.e., scope of implementation, extent and duration 
of product incorporation, degree of problem solution). 

External technical assistance played significant but differ- 
ent roles in facilitating both types of outcomes, Knowledge- 
Use/Implementation and School Improvement/Capacity Building. 

On the whole, the amount and divers-ity of resources for train- 
ing provided by experts and program developers that related 
directly to knowledge utilization objectives were more impor- 
tant than field agent (general ist) support in producing both 
knowledge utilization and capacity building improvements. ■ 
* » 

The general ist field agents were particularly Sfmportant in fa- 
cilitating improvement in the problem-sol ving behaviors of 
school staff, in increasing the overall level of effort, and 
in encouraging staff to expand the scope of problem defini- 
tion and solution search and to undertake implementation 
^of. more comprehensive solutions. However, a high level of 
involvement by agents may reduce capacity-building outcomes. 



t 



ERIC 



* These points enlarge on the summary presented in Louis, Rosenblum, Molitar, 
et al., 1981, pp. 227-228, and quoted at the end of Section III-C. 

**Compare this particular finding with the RBS/LSI agents who were co-opted 
by site staff into undertaking many of the RBS problem-solving process 
roles and were thus prevented from gradually withdrawing and leaving site 
teams to train others in the use of the RBS processes. 
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t The commitment of staff to undertaking more high quality, 

• comprehensive solutions, especially when these solutions 
addressed core school problems dealing with teaching and 
pupils, led to more pervasive product incorporation 

and greater problem "solving. 

t The strictly rational quality of the problem-sol vi ng pro : 
cess is less important in producing KU outcomes than has 
been thought; however, problem-solving quality (as repre- 
sented in measures indicating that core instructional 
problems were, in fact, identified and that the chosen 
solutions were were perceived by the staff as being of 
high quality and relevant to' the problem) is a consistently 
significant predictor of all major knowledge utilization 
outcomes. It is also a key to school improvement/capacity 
building outcomes. However, both quantitative and quali- 
tative data indicated that the RDU projects failed to make 
pervasive changes in the schools 1 problem-solving process 
or the general tendency of schools to prefer locally 
developed solutions and local expertise. , 

• School characteristics, such as staffs orientation to 
change and the amount of principal influence, were important 
factors affecting implementation of a problem-sol ving process, 
b'ut their combined influence was no more, and sometimes ap- 
preciably less, of an influence than the impact of the RDU 
intervention (product, external assistance, problem-solving 
process). 

"t The biggest payoff in terms of both knowledge util ization 
and school improvement was realized by emphasizing the 

• resolution of problems that affected the core activities of 
the school--teaching and pupils. 

t Costly change efforts were not more likely to have signif- 
icant impacts than less costly efforts. Indeed; greater 
reliance on federal funds had significantly negative re- 
sults on several outcomes, including lower incorporation 
of the problem-solving process, lower rates of problem 
solution, and lower personal and organizational impacts. 
However, in-kind school contributions had significant 
positive effects on product incorporation, personal impacts, 
and organizational impacts. Moreover, it is important to 
allocate large portions of resources to pay for teacher 
involvement, especially in selecting a solution and planning 
for implementation. 

• Finally, though not all schools followed program specifica- 
tions for a rational problem-solving process and implementation 
of an R&D-based or validated product, the RDU intervention 

had almost no significant negative impacts (see the RDU 
outcome typology, p. 3.46). 



9 

ERIC 



4.53 



Significant DESSI study findings . Since the DESSI study analysis 
is in process and the final report is not yet available, summary find- 
ings with respect to this study must be more tentative. However, here 
are some perhaps significant points: 

t The DESSI findings also pointed to two different types of out- 
comes: an individually focused set of outcomes and a school- 
focused set. 

t Characteristics of the implemented practice per se had very 
few significant relationships to outcome measures for any of 
the statistical structural model sclutions.* However, the 
degrees to which the innovation required a major or minor 
change in teaching practices profoundly" affected the pattern 
of factors that influence individual teacher outcomes. 

t As in the RDU study, external technical assistance was found, 
to play significant roles. However, the DESSI results dif- 
fered markedly among the models that were examined. The 
school -focused model displayed the clearest evidence of pos- 
itive and substantial effect of external assistance on the 
DESSI measure of organizational change benefits, which, in 
turn, was the only variable that had a significant effect on 
institutionalization of the practice. The individually focused 
models produced two different patterns of relationships, depending 
on whether the innovation required a minor or major change in 
teacher practices. External facilitators had little effect on 
any outcome measure when minor change was involved. The results 
for the major change group were initially counterintuitive, 
but informative. Though the External Facilitator Help factor 
fyas found to have no significant relationship to three of four 
outcome measures, facilitator help had a significant negative 
impact on teacher practice change. Secondary analysis, which 
unbundled this measure into its component, items,, indicated 



*This finding bears little if any direct relation to the RDU finding that 
good products produce good school outcomes, since the measures employed 
are vastly different. With the exception of a few local IV-C sites, all 
DESSI study sites were selected because they were already known adopters 
of a BEH, JDRP, or IVD val idated practice. Practice characteristics in' 
the DESSI study were represented by only two variables, the innovation's 
implementation requirements ({jor training, materials, personnel) and the 
prescriptiveness of the innovation (i.e., the range of variation deemed 
acceptable by the developer for the innovation's various components). 
The implementation requirements measure does not appear as a signifi- 
cant element in anj/ of the results reported. Prescriptiveness was found 
to have a negative relation of borderline significance with teacher class 
room change (in the individually focused model, where major change was re 
quired). Prescriptiveness was also significantly negatively related to 
time spent in evaluating the practice by teachers, but this variable, in 
turn, appears to have no significant relation to any of the other study 
outcome measures. 

t 
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that some aspects of facilitator help were positive, whereas 
others were negative. It appears that the more assistance that 
is^given to teachers in # working through the practice in its 
local context , the more positive impacf the external facilitator 
is likely to have.* * 

t Though outside help from specialists and developers was a sig- 
nificant influenoe at RDU sites, its effect In' the DHSSI study 
was less % clear, but was at least positive. * 

*t Extensive compliance- with a rational problem-solving process' 
was generally not- emphasized in any of the programs included -\ 
in the DESSI* study and was therefore not treated as an im- ^ 
portant predictor variable. Perhaps the closest variables to 
process measures in the DESSI study were those that Measure r 
time spent by teachers orfivarious aspect s / 5fL the innovation 
i mp 1 erne nt at 1 on.*** 

• However, school and- staff characteristics and local sources 
of support (fronr district level administrators and from ' 



*** 



Recall that Cox and Havel ock indicated that external facilitators often 
worked with school staff off-site and that, indeed, much less than half 
the sample of external facilitators said they were "familiar with the « 
practice as used at the selected site.. This result seems comparable to 
the significant relationship found in the RDU study for amount of field 
agent time spent at the site. 

We first ffbte that in* the DESSI study the majority of the External Facil 
itators were, in fact, NDN or state Title IV-C Developer/Demonstrators 
(D/Ds). The facilitator generalist (here SFs) and specialists-developer 
(here D/Ds) roles, jvhich were separated in the RDU study, are confounded 
in the DESSI study, since all are classed as External Facilitators. In 
the DESSI study, a measure pf outside help (from. External Facilitators 
or others) to individuals was reported to have a significant positive 
relation to just one outcome measure: benefits/gains on the part 
of teachers required to make a major change. * 

In the individually focused model involving teachers who were required 
to make major changes in theie practice, time spent by teachers on 
the practice in the classroom.and time spent on working with the ma- 
terials were both of borderline significance in positively affecting 
changes in teacher practice. Time spent 'on materials was again of 
borderline, positive significance in affecting practice-specific mast- 
ery; however, teacher time spent in communicating with others about 
the innovation and its implementation' was positively and significantly 
related to practice-specific mastery. Finally, time spent in the prac- 
tice in the classroom was of borderline significance in positively 
affecting the fidelity of adoption. Time was not significantly re- 
lated to benefits/gains. 

» 
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school principals and others) were major areas of interest 
and concern for the DESSI researchers. Principal help and 
help from loca} facilitators proved to be a significant ele- 
ment in influencing many outcomes.* °In addition, at least 
two school context measures (which were employed only in the 
school-focused model) were found, to have significant influ- 
ences. Large districts were positively associated with great- 
er staff readiness, principal commitment and leadership, and 
user mastery. However, large schools were associated with 
lower readiness and commitment, but greater principal lead- 
ership. Readiness for change was a significant antecedent 
to practice change for individual teachers. Characteristics 
such as faculty attitude toward school improvement, teacher 
commitment, and existence of a conducive environment for 
problem-solving entered as significant predictors in the 

school-level , outcomes model. 

» 

e The DESSI models thus generated at least three different im- 
ages of school improvement. When only small changes on the 
part of individual teachers were involved, only elapsed time 
^and teacher commitment (e.g., sustained individual teacher 
effort) proved to be significant factors. Neither external 
nor internal assistance, nor any other' context, process, or 
practice characteristic was found to have a significant re- 
lationship.** When major change was required of individual 
teachers, far more complex predictor-to-outcome relation- 
ships were found, but most of these significant relationships 
involved staff readiness for change, time spent on the inno- 
vation, or local assistance, such as principal help oV help 



* Principal help was significantly related *to perceived benefits/gains 
and to fidelity of innovation adoption in the individual-level model, 
where major change was required of teachers. In the school -focused model, 
principal commmitment was significantly related to principal help, which, 
in turn, positively affected practice-related mastery. Principal 
leadership was at least of borderline significance in positively r 
affecting (along with an even stronger influence from external facilitator 
help) the level of organizational change, which, in turn, significantly 
affected the institutionalization of the innovation. Help from local 
(central office) facilitators significantly influenced teachers 1 change 
in practice and had a borderline significant impact on the amount of 
benefits teachers attributed to the use of the practice. In the school- 
focused model, central office help showed a direct and significant 
relationship to teacher commitment and was also the only variable in ^ 
the school -focused model that showed a possibly significant relationship 
(of borderline signifance, i.e., more than .10 but less than .05) #ith 
the strength of teachers* feelings th*t the adopted practice solved the 
problem they had faced. * 

**We note that this finding suggests that* minor change teachers are thus 
prime targets for agents who are forced to deal with high scope (many' 
clients) and low intensity job demands that are typical of Informa- 
tion Use Assistance stategies. 
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from local central office staff* As we have noted, the / 
effect of exte^npal facilitator help can be either positive 
or negative/depending on the particular type and location of *"~^\ 
external assistance. Finally, when the model shifted to 
examination of ^factors influencing school-focused outcomes, 
a highly complex pattern of significant relationships was 
found. It is in this model that the most positive and signi- 
ficant effects of external facilitator help were demonstrated. 
The role of the principal was also important. Principal / 
management style, principal leadership, principal commitment 
to the innovation, and principal help were each positive / 
influences on one or more outcome measure.. Other positive 
influences included: local facilitator help, teacher sense of 
control, and teacher commitment. Size of school district 
and size of school al;so were, significant influences.* 

• t The biggest payoffs in terms of practice improvement for in- 
dividual teachers was realized when teachers undertook the 
implementation of innovations that required them to make major 
changes in tjieir practices. When this occured, a variety of 
primarily local forces appeared to come into play to help in- 
fluence positive outcomes. When minor practice change was 
undertaken, elapsed time since adoption and individual teach- 
er commitment were the only significant factors needed to ex- 
. plain the>usually limited outcomes. 

t The major contribution of external agents , 'other than intro- 
ducing the innovation, appeared to be in their direct and 
signi ficant*ef feet on organizational change benefits (i.e., 
nonindividua] benefits resulting from implementation of the 
innovation), which, in turn, provided the only significant 
path to institutionalization of the innovation. 



5. Discussion and Commentary * 

The RBS/LSI, RDU, and DESSI studies are all remarkable contributions 
to the empirical literature on linking agents on at least three counts. 
First, they provide us with some knowledge* regarding intermediate or more 
distal outcomes in schools as a result of li nki ng-agent^initiated efforts 
to assist school staff to implement improved school practices. Second, all 
three studies provide da'ta that indicate how external assistance, local 
assistance (from central office administration and school principals) and 
school staff characteristics/activities interact to account for outcomes. 
Third, ad 1 three studies have relied heavily on a .combination of quanti- 



*Perhaps two unusual and as yet unexplained elements in the school-focused 
model are, first, that school adminstrator (superintendent) power over 
the implementation entered as a zero path coefficient; and, second, that 
faculty attitude toward school improvement displayed a significant 
negative path to the organizational change outcome. 
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tative and qualitative data to present, explain, and illuminate tHein 
findings. 

The RBS/LSI study involved only II sites and a handful of predictor 
measures derfved from extensive ethnographic notes. and reports. ' Per- 
haps the truly remarkable finding here is that, despite such a small 
sample, statistically significant quantitative relationships were demon- 
strated. By' contrast, both the RDU and DESSI studies are indeed massive, 
in the number of agents and sites involved, in the number of data ele : ' 
ments per agent and site that were recoreded, and in the extent and com- 
plexity of the data analyses that were performed. This wealth of data 
presents immensely more detailed* and complex images of the interplay of. 
forces than could be depicted by the few variables Jn the RBS*/ LSI study. 
However, there are some consistent themes acrogs all three studies. 
First, there is the point that the local context,^ including schooV and 
'staff characteristics, readiness, and motivation, is 'extremely important 
in accounting for outlines. The second common theme is that local he,l p 
from central office stdff or school principals is also important. A 
third theme 1s that the nature of the tnnoyat^on and, more particularly, 
the demands it places on local staff to undertake major changes are 
important. A fourth theme is that external assistance .can be important, 
but the size, nature, and even the positive or negative direction.©! 
influence depend on many factors (such as where, when, how, by whQin, 
and for whom^Hs external assistance provided. Finally, .a fifth theme 
is that impacts vary, depending on what you look at.' 

Here are some comments on these five themes, taken in reverse order:- 

Multiple outcomes . The Abt researchers made the point that they at- 
tributed the highly significant positive effects of RDU on schools to two 
major causes. First, the RDU strategy combined extensive external tech- 
nical assistance, quality products, and a sophisticated bi)t practical 
problem- solving process to achieve its effects. (Indeed-, among all the 
[Programs, RDU is the only one where there isafclear, robust; and reason- 
ably compelling evidence that the combined effect of the external inter- i( 
vent ion either matched or exceeded the local context/factors.) Second, 
the Abt researchers took a very broad view of possible outcomes- They 
noted that if. their study had beon confined to an emphasis on only prod- 
uct incorporation and problem r sol ving process incorporation, as measures 
of long-term success at the* school level, the RDU- success story would 
have been much less impressive.. They concluded that success is, in part, # 
a matter of definition. Where major change -efforts are involved, they, 
ought to be matched by an effort to measure broad impacts that cover j 
variety of types of possible outcomes. : * 
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*Major outcome, variables included: (]) satisfaction with the field -agent , 
. (2) satisfaction with the problem-solving process', (3) scope of implemen- 
tation, (4) extent to which the problem was solved, (5) degree of incor- 
poration of the adopted product, (6) personal impacts, (7) impacts on the 
school as an organization, and (8) incorporation of the problem- sol ving 
process. 



The OESSI findings reinforce this view of the need for alfo useful- 
ness of multiple outcome measures.* Again, nad the DESSI study confined 
its findings with respect to outcomes to, say, 1 individual teacher prac- 
tice change and individual teacher practice-specific mastery, and had 
the" researchers not "unbundled" their measure of help from the external 
facilitator, we would have been confronted with the puzzling and perhaps 
uncomfortable finding that external facilitator help has a significantly 
negative effect on one outcome and no effect on the other. We would 
have missed the fact that outside help for individuals significantly 
affects individual benefits/gains for teachers and would ha.'t failed to 
discover the significant positive effect of external facilitator help on 
organizational change benefits and program institutionalization. 

The lack of a larger and broader set of outcome measures in the RBS/ 
LSI study is perhaps the counterexample that makes the'point. Here we 
are told that the linking agents were highly useful because they mediated 
the extremely negative effects of RBS-site tensions on both team pro- 
qress and team sense of ownership outcomes, but we are confronted with 
sparse data that present no clear image of the innvQation(s) that were 
implemented, the linker behaviors that were employed, or the site outcomes 
that might begin to match the rich but totally qualitative descriptions 
provided, by Corbett. Perhaps the moralhere is that limited measures of 
, success run the risk of producing limited evidence of sv-cess. 

Complex linking a^ent j?£fejc_ts. This theme is an extension of the pre- 
vious one. When mult ip'fe" Tm-asures" of linking agent assistance are com- 
bined with multiple measures for outcomes and other factors, complex but 
meaningful patterns of- impact results are obtained.; Moreover, when) ef- 
fects are examined on different levels, different patterns are found. 
Here are some Specifics. The DESbl study found that help from the extern- 
al facilitator had no discern ih'le effect on any of four i ndiv iduar teach- 
er outcome variables when only minor changes in practice were involved. 
However, when major changes in practice were involved, the. gross measure 
of external facilitator help had a significant negative effect on one 
teacher outcome measure, change in practice. When the external assistance 
measure is reduced to its components, "it turns out that, some kinds cf 
ext. rrul help are negative and others am positive. Detailed examin-. 
at ion of the relationships among variables suggests that how agents allo- 
cate their time among assistance functions a'nd .where assistance is given 
account for the differences. Positive effects of external facilitator 
help are produced when direct, on-schooi-site assistance is given in help- 
ing teachers to work through the processes of the innovative practice 
in its local context (i.e., assistance given to teachers in planning 



*The Of SSI individual 3y-focused model included four major outcome vari- 
ables- (1) perceived benefits, (2) change in practice, (3) practice- 
spec ftc mastery of the innovation, and (4) fidelity of adoption. The 
schoo -focus model included: (1) plans for continuation, 2} benefits 
due to organizational cfonge, (3) institutionalization, (4) teacher 
commitment. (5) practice-related mastery, (.6) personal gams, and (7) 

• degree' to which the practice solves user problems. 
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plementation schedules; providing technical assistance or follow-up train- 
ing; assisting teachers in working out procedural details, developing plans 
to support continuation; and developing additional new users at the" site) 
(Cox and Havelock, 1981, p. 19). The converse, of course, is that total 
amount of external facilitator help, especially when time is allocated 
to other types of dctivities and especially when those activities do not 
deal with specific school site implementation problems, can actually 
have a negative effect by depriving teachers of the type of assistance 
they nee^ most. This general conclusion is reinforced when we find a 
statistically significant and direct positive effect of the measure of 
outside help for individuals and personal benefits/gains reported by 
teachers. And, finally, as we have repeatedly noted, external facil- 
itator help emerged as a major predictor of organizational change bene- 
fits and institutionalization of the practice in the school-level model. 

The ROU external ass i stance patterns are even more complex, but 
informative. Hero dre some specifics. An aggregate measure of site 
staff satisfaction with the field agent for 180 RDU school sites indicated 
that this measure was significantly related (P < .05) to five other outcome 
measures: satisfaction with the problem-solving process (r = .42), per- • 
sonal impacts (r = .27), organizational impacts (r = -26), degree to which 
problem was solved (r = .18), and scope of implementation (r = .16); but 
it was not significantly related to R&D product incorporation or the pro- 
cess incorporation. When seven measures of the external assistance 
(as contrasted to staff satisfaction with assistance) wore correlated 
with six outcome measures (N - 75 schools), four of the seven assistance 
measures displayed statistically significant correlations (P < .05) with 
edch of three or more of the six outcome measures. Field agent initiative 
and field agent intensity of services each displayed a significant relation- 
ship (correlations ranging from .33 to .49) with scope of implementation, 
product incorporation, and organizational impacts.* Field agent initiative 
and intensity wore unrelated to personal impacts, process incorporation, 
or degree to which the problem was perceived as solved. However, the 
two external assistance training measures, amount *of training and variety 
of training resources, displayed significant correlations with aJJ six of 
the school improvement outcome measures (with correlations ranging from 
.26 to .59) (Louis, Rosenblum, Molitar, et al., 1981, p. 112). It is 
this significant and pervasive effort of training, as contrasted to the 
more limited but significant effect of field agent (generalist) initiative 
and intensity of service, , that caused Louis and her colleagues to distinguish 
between the effects of generalists and training experts. The two types 
of assistance combined to produce quite different results in accounting 
for the six school outcome measures; multiple correlations indicated 
that these combined sources of external assistance were, by themselves, 
able to account fcor 40 percent or,mon» of the variance in three outcomes: 
scope of implementation (46X), product incorporation (43%), and organiza- 
tional impacts (40%). However, t.heir combined effects accounted for * 
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*A11 relations were positive, except f.A. Service Intensity and Product 
Incorporation (r -.40). Apparently, overly intense agents inhibit ef- 
l( etive product incorporation. 
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substantially less of the total variance .in the other three outcome 
measures: problem solved (21%), personal impacts (19%), or process 
incorporation (14%). We thus see that external assistance has substan- 
tially greater effects on some school improvement outcomes than on others, 
that the effects of training tend to be more pervasive than those of 
generalist-facilitator assistance, and that both types of assistance 
combine to produce incrementally positive effects for several outcomes 
(most notably scope ; df implementation and product incorporation). 

Innovation characteristics and demands . The RDU study again provides 
the richest source of 'information on the relation of the characteristics 
"of the innovation to outcomes and to other variables. With approximately 
100 different products represented in their school site data samples, 
and with 11 measures of product characteristics and /; six outcome measures, 
the RDU study produced a number of significant correlations that seriously 
challenge the notion that product characteristics are not important in ex- 
plaining implementation and school improvement outcomes. Among the 11 
product measures, the three most robust predictors (significant coeffi- 
cients in three or more regression equations) were product quality (as 
perceived by users), product complexity, and difficulty of implementa- 
tion. Surprisingly, all three variables exerted positive influences. That 
is, the more complex products (in the sense of the number .of things that 
must be changed in order to implement the product) and the more diffi- 
culty teachers reported they experienced in implementing the products, 
the greater was the positive impact on various outcomes. Product char- 
acteristics alone accounted for substantial portions of outcome variance. 
Indeed, half the variance in the measure of the degree to which the 
-problem was solved was accounted' for by five product characteristics, but 
principally by product quality and difficulty of implementation. More 
^than a third of the variance is .predicted for all but one -of the six 
outcome measures. * 

When we turn to the DESSI study, we find a more limited set of find- 
ings. Perhaps the most notable point is that the DESSI study analysis 
of predictors of outcomes for individuals (individually focused model) 
nade no progress until the sample was split into teachers for whom the 
innovation represented a major or minor change. When this was done, 
significant but different patterns of predictors were found i*n both 
samples. Although the RDU data on product characteristics were aggregated 
to site rather than individual teacher, there is a remarkable correspondence 
between the RDU product characteristics of product complexity and difficulty 
of implementation, which positively affected outcomes, and the DESSI 
distinction of minor versus major practice^ change. After splitting the 
sample in terms of the teacher practice change requirement, the DESSI 
researchers employed two other practice (product) characteristics employed 
as predictors in the individual outcomes regression models: prescriptive- 
ness of the innovation and implementation requirements (training, materials, 
personnel). Only pres:riptiveness was found to be a marginally signify 
icant (P < .10) predictor of one outcome, that of teacher practice, change. 
Highly prescriptive innovations (permitting little adopter latitude) 
inhibited practice change. Innovation characteristics are not repre- 
sented directly in the DESSI school -focused model of outcomes. 

f 

*See Table 4, Secfion A I I-C, for the outcome variables and the exact values. 



The RBS/LSI study provided only qualitative and vague descriptions 
of the innovations characteristics of the three RBS school improvement 
components (basic skil]s, career preparation, and citizen education), 
and no cross-tabulations by type of RBS component or its characteristics 
was reported for the 11 LSI team*;.* 

The importance of local assistance . Local assistance as provided by 
central office administrators or school principals, was found to be a sig- 
nificant influence in all three studies. These effects were muted in the 
RDU study, where the focus was heavily on team effort. The principal's 
role as an instructional leader exerted small but significant influences 
on organizational impacts (r = .25) and degree to which the problem was 
solved (r_= .15). The principal's influence in decision making also ex- 
erted a small but significant positive influence on organizational out- 
comes. On the otner hand, the influence of the superintendent and of other 
central office staff on outcomes was usually insignificant and often mildly 
negative, with just one exception--where central office staff appear as 
a significantly negative predictor of problem-solving process incorpora- 
tion. Principal, teacher, and faculty influences were all positively re- 
lated.** 

In the DESSI study, the principal and the central office stafif ap- 
peared as much more prominent predictors of both individual and school- 
level outcomes. Help from the principal and help from the central ^office 
both enter as significant or borderline significant predictors of individual 
teacher benefits. Help from the central office staff (who were oft^n 
curriculum or instruction specialists) significantly influenced changes 
in teacher^practice. Teacher pract ice-speci ftc mastery, however, depended 
primarily on the time teachers spent on the practice, mainly in classroom 
practice and in communication with others about the practice and its 
implementation. Principal help was the primary factor affecting fidelity 
of implementation, with teacher time spent in classroom practice also 
contributing marginally. As we have noted elsewhere, a number of local 
principal and staff factors exerted significant influences in the school- 
focused outcomes model. These included: principal leadership, principal 
commitment, principal help, and local facilitator (central office) help. 



However, we are left with the impression that differences among 
the three RBS components in their demands on sites to conform 
with tfoeir particular change process approaches may have contributed 
to the significant and highly negative relations between the RBS-team 
tension and the team's • progress and team sense of ownership. 

Most RQU projects were school -based rather than district-wide. The 
majority of the superintendents or assistant superintendents (68% during 
problem implemontation ; 82% during implementation) had little or no in- 
fluence on decisions related to the projects. Other central office staff 
were more likely to take part, but their influence was usually much less 
than that of the school principal on teacher. 
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Finally, the RBS Local School Improvement Study found that the degree 
of central office staff support was perfectly correlated^ with team progress 
and thus appeared as the most powerful positive effect on this outcome 
measure. • 

• Staff and other school con te xt infl uences. The RBS/LSI study pro^- 
vided no data on the relation of school context measures to outcomes or . 
other variables.* However, teacher problem-solving motivation was a pos- 
itive and powerful predictor -of both the LSI teams progress and its sense 
of ownership of the curriculum improvement effort. 

Teacher commi tment .to the innovation and time spent on the innovation 
•were the only relevant variables of this type that were* employed in the 
DESSI models of individual teacher outcomes. As we have noted, the 
teacher's commi talent to the innovation and the length of calendar time 
the teacher had been using the innovation were the only significant pre- 
dictors of outcomes where a minor change effort was involved. Where major^ 
change efforts were involved, time spent by the teacher on various aspects 
of use (i.e., classroom, materials, communication with others) was a sig- 
nificant, or at least borderline, influence on change in practi ce, k practice- 
sperific mastery, and fidelity of implementation outcomes. Teacher 
reaoiness for change was also a significant predictor of change in practice. 

In the DESSI school-focused outcomes model, both size of school and 
size of school district showed significant or borderline influences on staff 
readiness, principal commitment (which, in turn, affected practice-related 
teacher mastery), and principal leadership (which, in turn, affected organ- 
izational change benefits, which,, in turn, affected institutionalization). 
Size of school district also showed direct positive effects (but of border- 
line significance) on practice-related mastery and on teacher commitment 
(which, in turn, positively affected the measures of staff perceptions of 
advantages and personal gains). The DESSI findings thus indicate that both 
school size and district size act as important influences on various school 
improvement outcomes. Teacher control, teacher commitment, and faculty 
attitude toward the innovation and the conduciveness of the environment 
to, problem-sol ving are also significant influences on school-level outcomes. 

Even when we exclude RDU site characteristics measures dealing with , 
superintendent, central office, or schooj principal variables that we con- 
sidered in the previous section, the RDU study reported -data on more than 
a score of variables that define characteristics of the teaching staff, 
school size, structure, and climate, and the community setting. When 
these variables were related to each of the six major RDU outcome measures, 
well over 100 correlations were produced. Examination of the correlations 
and a series of multiple regression solutions led the Abt researchers to 
these summary findings: • - 

• Variables measuring the school's climate for innovation were 
quite significant in explaining change, "with particular im- 
portance being accorded to variables tapping the teachers 1 
orientation toward change and the experience of the school 
in prior problem-solving activities related to the problem 
in question, 

^However, torbett, Dawson, and Firestone (December, 1982) which was not 
available in time for this review, does consider a number of school context 
influences. . 4 ' 
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• Also important in explaining school outcomes was the natu re 
of the problem : a focus on classroom organization and/or 
pupil achievement tended to be associated with higher levels 
of change. 1 

» • 

• Structural features of the school, particularly. the degree 
to which teachers influenced the defcision-making activities, 
affected the outcomes of the change. 

• Unl ike iiid ay other studies, -the data do not indicate that 
demographic characteristics of the school, including prin- 
cipal demographic characteristics, teacher, demographic 
characteristics, or student demographic characteristics 
have profound impacts on the outcomes of participating 

in an innovation [RDU] program . . . 

• These findings suggest that local site characteristics that 
affect the outfcomes of the change process are those that 
may, in fact, be the most susceptible to change themselves. 
Thus, it is difficult to alter the level of a school—whether 
it is secondary or elementary/ However, teachers with atti- 
tudes that are unsupportive of change may, in fact, be made 
more positive if they are given reasons to believe that their 
efforts will be rewarded and will produce something of value. 
Similarly . . . , it is relatively simple to begin a major 
change program by c^ohasizing issues that relate to class- 
rooms and pupil?. (Louis, Rosenblum, Molitar, and others, 1981, 
p. 162, bullets added.) 

Conclusion . In this section we have reviewed a wide variety of find- 
ings regarding the effects of external and internal agents and other fac- 
tors on various -outcomes of school improvement efforts. In the aggregate, 
they provide impressive evidence that externally initiated and facilitated 
change efforts can produce positive changes in schools, both in the cur- 
riculum and instructional practices of individual teachers and>in the 
organizational relationships and problem-solving structures and processes 
of schools as organizations. These changes, In turn, lead to many other 
organization and personnel benefits for schools, for staff, and for stu- 
dents. Moreover, although the total change costs, including in-kind 
contributions of site and school district staff time Snd effort; were 
modest, large, broad-scale change v/as often accomplished and these efforts 
were usually associated with large* payoffs. If little was ventured, little 
was gained. v A related point 'is that large amounts of external support 
(whether in dollars or assistance effort) were not always required and 
could sometimes even be counterproductive. What seems to matter is when, 
where, and how external assistance is provided and toward what aspects 
of the complex sequence of change events it is directed. 

Many of the effects of external assistance are indirect and perhaps 
missed in the measurement of effects. Certainly the role that external 
agents and agencies played in initiating the innovation effort and in 
helping to introduce potent products and problem-solving practices may 
be overlooked when a study focuses only on more direct measures of agents 1 
contactsand activities. And as we have seen clearly in both the RDU a/id 
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the DESSI studies, external facilitator-general i-sts often make their most 
potent contribution in getting things started properly and attending to 
organizational factors that mobilize and sustain local staff interest, 
commitment, help, and participation. We have also seen that these 
agents can play other potentially important roles in finding and introducing 
appropriate high-quality products and practices, in encouraging broad 
staff participation in solution selection, planning for implementation 
and other phases of the change process, and in helping to identify and 
arrange for intensive and extensive expert assistance and training at 
appropriate times. Indeed,, as we see clearly in both studies, these 
forms of outside expert assistance were often the most consistently 
positive, pervasive, and potent sources of external assistance. 

However, the effects of external assistance on outcomes were^ often 
matched by sources of internal assistance, beginning first with teach- 
ers themselves, and then often extending to potent, if sometimes subtle, 
roles played by school principals. The role of central office staff can 
also be important, but seems contingent on program design and other fac- 
tors. * 

Perhaps the key point in all these findings is that external as- % 
sistance can help schools to improve in very powerful ways by initiat- 
ing and helping to orchestrate a wide variety of internal arid external 
personnel, material, and knowledge resources so they can be focused, 
organized, and applied in systematic and sustained efforts to address 
significant education problems. Typically schools and school staff are 
organized to pursue relatively individual and isolated job roles where 
attention perforce must be given primarily to "maintenance" and "coping" 
with routine daily activities. As Fullen has noted, neither teachers 
nor principals nor central off ice* staff are typically able to play ef- 
fective knowledge uss/implementation roles by themselves. The available 
research strongly suggests that this failure is due to the way schools and 
school districts are organized, the way individual jobs are structured, 
and the way goals, motivation, incentives, and rewards for school improve- 
ment are defined and managed. Our argument is that, in comparison to 
Knowledge Use Assistance Strategies (e.g., SDGP) or the various forms 
of Technical Assistance Strategies (e.g., RBS/ESA), the great power and 
high payoff of these Problem Solving/ Program Implementation Strategies 
(as evidenced especially in the RDU and DESSI data), are to be found in 
the fact that the external agents went far beyond assisting individuals 
in finding and learning to use relatively diffuse forms of knowledge, or 
to deal with specific but often isolated curriculum changes, or to acquire 
particular but often unrelated sets of skillsi Rather, the agents employing 



*Central office assistance was riot shown to have appreciable effect on 
any of the RDU outcomes, except for a negative effect on the incorpora- 
tion (continuance or repeated *use)Pof the RDU problem-solving process. 
However, central office ("local facilitator") help positively and 
significantly affected instructional practice change and instructional 
practice gains and benefits in both the DESSI individual-focused and 
school -focused models. In the RBS/LSI study, central office support was 
perfectly correlated with local site team progress in the school improve- 
ment process and was highly correlated with teams' sense* of ownership. 
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Problem-Sol vi ng/Progr am Implementation Strategies undertook initiation 
and ^support of far more comprehensive school improvement changes involving 
highly practical, proven, and' (site) contextual ly relevant solutions for 
significant instruction and pupil performance problems. They also helped 
school staff to deal mo«£ directly with the organizational, job-related, 
and motivational impediments to mobilizing and sustaining team efforts 
to deal with school-improvement problems. High quality products, effective 
problem-solving and implementation processes, and local, timely and 
appropriate training and technical assistance 1 could then*all play positive, 
complementary, and incrementally additive roles in contributing to a 
wide variety of school improvement outcomes and* benefits. But it may 
well be that the mobilization and continued support of school staff to 
work, as individuals and as teams, on school improvment efforts that go 
far beyond those they are able to address individually in the normol 
context of their daily work, are the fundamental keys to the success of 
these external assistance strategies. 
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I. Iffocts Of Program, Host Oryanlzatiqn, 
find Tff enTs TTn 1 1 nkTn g~ ftgenf Act i v i ty 

The theoretcial conceptions of linking agent roles reviewed in Sec- 
tion II-A specifically considered the different roles that linkers might 
play, depending on their programmatic entitlements.,. 

In Section IV-A, we saw how program and type of agency--but, perhaps 
more fundamentally, the type of dissemination program strategy and the 
geographic scope of the agents' service region- -powerfully interact to 
define the general patterns of roles and expectations for linking agent 
work. In Section IV-C, we saw how these different strategies .resulted 
in markedly different findings regarding the specific scope and nature- 
of linking agent work,* as defined in results of factor analyses of the 
roles and activities played by agents. However, these are rather gross 
and largely static images of what is, in fact, a far more complicated 
and highly dynamic interplay of numerous, complex interorgamzational 
and interpersonal transactions. These transactions are played out over 
periods of iime that, are often are measured in years, rather than months 
or days, and involve different types of organizations are often operating 
in highly different contexts. 

The effects of these contexts on linking agents were also considered 
bv the reviewers of the theoretical and empirical literature described 
in Sections II-A and II-B. CrandalT gave special attention to the universe 
of the linking agent" in terms of the three systems in which the linker 
Is involved: the resource system, the client system, and the linker s 
host agency. Each of these systems represents perhaps vastly different 
cultural, organizational, technical, and social ""^"rations Jhat 
call for skills and sensitivities in comprehending and coping with the 
goals, motivations, operating assumptions, and preferred styles and 
interests of various persons, groups, and organizational divisions and 
levels of each system. " The linking agent's task (whether pe rformed by a 
single person, a team of persons, or an "agency ) is to act as the lrtter 
mediary, .playing a two-way translation role, relative to resource Systems 
UnTTOng sponsoring offices), client systems, and host agency 
Butler and Paisley further note that these systems are all multidimensional, 
including historical, political, economic, social, psychological, and 
cultural contexts that may or may not match. To the extent that the 
linking agent and each of these types. of organization (resource systems, 
clients, host organization) share the- same contexts (e.g. .cultural , , 
historical, political, social, economic), the work of the linking agent 
is eased especially in playing an intermediary, boundary-spanning 
role HoweSer! when the discrepancies are large, linking agents confront 
numerous problems, e.g. . in defining their job position; negotiating 
their "entitlement"; interpreting and responding appropriately to tne 
expectations of others; reducing role conflict due to inconsistent or 
incompatible Expectation of others; selecting and employing consistent 
and appropriate strategies and tactics; securing appropriate and timely 
resources and support to perform needed tasks; deciding on the allocation 
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of time and effort for various roles, activities, and tasks in terms of 
competing priorities and needs; interpreting and reconci 1 i ng the aims 
and expectations of others relative to their own view of what should be 
done and what they themselves should do; and, ultimately, assessing 
their own sense of mission, worth,' and accomplishment. 

Boundary-spanning roles are often stressful, and, as the RDU study 
data especially demonstrate, agents sometimes reduce this stress by 
assuming "marginal" stances not closely associated with any one 
organization or by complying with more minimal client expectations 
to play more conventional content export roles. Moreover, these stresses 
undoubtedly increase as agents assume broader entitlements t'hat call 
for more intensive programmatic involvement with clients that, in turn, 
require the coordination of many persons, groups, and organizations 
within and beyond the'client agency. We note in particular the RBS/LSI 
study, where mediation of interpersonal and interorganizati^onal tension 
between and among teachers and administrators Within the local education 
agency, and reducing tensions between the school sites and the RBS com- 
ponents became critical roles, which agents had to play successfully if 
the school improvement projects were to continue. Indeed, Corbett (1981) 
noted that, in addition to the original set of three primary technical 
functions that were assigned to the agents by RBS, at least five addition- 
al functions emerged that wore largely related to obtaining the kinds of 
resources and social relations necessary for the change process to con- 
tinue. 

The Abt RDU study (especially Louis and Kell, 1981, but also Louis, 
Rpscnblum & Molitar, 1981; and Louis, Rosenblum, ct al., 1981) provide 
an immense set of data and descriptions of field agent roles in their m 
organizational contexts and of the dynamics of interorganizational* net- 
works within which these agents worked. The scope of the Abt researchers' 
analysis is indeed immense, since they measured and related many variable 
sets, including those defining: personal characteristics of the agent; 
the design of the agent position; the xharacteristics of tfip training 
given the agent, the self-reported levels of skills possessed by. the 
agent,' the degree of support given the ag^nt by supervisors and col- 

■ leagues, the degree to which supervisors and colleagues influenced the 
agent's role performance; the agent's perspective of change (i.e, whether 
or not the agent believed that political systems, individual incentives, 
or the social structure of the schools best explained and conditioned 

.the outcomes of school change efforts); the roles and activities that 
agents performed and how these related to their own and others' expecta- 
tions; the jofc-related atticudes of agents, including their. sense of 
commitment, their sense of role conflict, and their sense of organizational 
marginal i ty ; the characteristics of the agent's relationship with sites, 
including the agent's infTuence over site activities and decisions; the 
foundations for the agent's influence over sites, and the influence of site 
administration on field agent activities and time allocations; and, 
finally, measures of the field agent's own sense of effectiveness (Louis' 
and Kell, 1981). Then 'in subsequent analyses, they related selected 
measures derived from this massive search for the patterns and determinants 

j of agent roles, activities, and relationship to a broader set of variabTes 
that included measures of client (teachers' and principals 1 "') satisfaction 
with the agent ,apd tfie problem-solving process, and also s^x major measures 
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of school improvement outcomes (iouis, Rosenblum, Molitar, et al , 1981). 
See Section IV. D. above for the summary of the latter analysis regarding- 
agent effects on sites and school improvement outcomes. 

However, with respect to the factors thayt affect agent roles and 
activities, Louis and Kel 1 provide a particularly succinct conclusion: 

What field agents actually do in carrying out their 
jobs is . . % a f unction of a variety of factors. 
Two influences on roip enactment are most critical: 
the*support and influence system set up by the spon- 
soring organization, and the influence an/3 inter- 
actions with key school-level administrators who 
act as gate keepers in defining what the agents 
will do in their districts. In sum, what agents 
do is primarily a function of the patterns of 
> interpersonal influence in which they are embed- 
ded . Most notably, higher levels of influence 
from all major role partners--the project director, 
project evaluator, host supervisor, and site ad- 
mi ni strator—tend to lead to more extensive per- 
formance of "boundary-spanning activities," i.e., / 
those activities through which ajents communicate 
information and influence across organizational 
boundaries. High levels of influeage from pro- 
ject staff tend to lead to a greater emphasis 
upon the "program change expert" role, where the 
agent is actively involved in assessing the match 
between site problems and innovations, implement- 
ing those innovations, and evaluating the out- 
comes [which is consistent with the RDU project's 
definition of purpose and missijSn of the agents]. 
Conversely, high levels of influence from the 
host supervisors tend to lead to an emphasis oa 
the les£ intrusive "content specialist" and "gen- 
era ii s t -coordinator" roles. (Louis and Kell,' 
1981, pp. 168, 170) 

A related significant finding of their RDU analysis was that agents 
with a high sense of local marginality (i.e., Vow sense of affiliation 
with either their "host organization" or their local school si.tes) were 
less likely to adopt the program .change expert role and were also less 
likely to engage in boundary^s^anning activities. Older agents and 
agents with more teaching e^riehce were also less likely to engage in 
boundary-spanning activities. However, the more field agents engaged in 
boundary-spanning activities, the more role conflict they perceived. 
Given the apparent differences in expectations between project and host 
organization supervisors, on the one hand, and those of site administra- 
tors on t.he other, as indicated by the signi ficant. correlations between 
different sources of influence and these competing agent roles/activities, 
it is little wonder that intensive boundary-spanoing agents should perceive 
role conflict. However, neither role conflict nor the speci/ic roles 
that agents assumed and the activities they performed had very great 4 , 
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impacts on intermediate measures of agent effectiveness, including 
client satisfaction with the agent and the process, the agent's perception 
of program success, and the agent's assessment of the quality of local 
site decisions and activities. 

The Abt researchers found that the general strategies ( i .e. , perspectives - 
on change) that the agents adopted were more important^ than'the specific 
roles. A political change orientation, which was overwhelmingly avoided 
by RDU agents, was particularly effective in increasing principal satis- 
faction, but it had an opposite effect on teachers. An individual 
incentives orientation that attended to individual needs and concerns 
created a more favorable impression among teachers and was the most 
popular approach among agents. A structural perspective orientation 
that invol ved' emphasis on understanding rolesy d i v i sion of labor, and 
rational organizational planning processes was el so popular among 
agents and was associated with higher agent job satisfaction, but 
generated mildly hegative response from •school principals. It thus 
appears that different perspectives may work well in some situations 
and with some role groups, but less well in others. Hence there may be 
no one specific strategy that is particularly effective. But more 
generically, a low-key supporting orientation to change that emphasized 
industrious, dependable, stable, cooperative behavior over more "innovative" 
characteristics (i.e., inquiring, original, self-rel iant jpCflexible) 
generated significantly greater satisfaction among teachers and principals 
with both the agent and the change process they supported. T^is one 
pattern emerged most clearly and_ consistently as a successful agent 
strategy for producing client satisfaction; however ,~~6ven it was totally 
unrelated to other measures of school improvement outcomes. Moreover, 
the Abt researchers confirmed Hal 1 1 i findings regarding the lack of coherent 
agent strategies (see footnote, p.2,.20) by noting that the RDU field 
agents tended to not be explicitly aware of their overall strategies for 
change: • ( 

Unless forced to reflect on their assumptions / , 

about how*'t'he change' process proceeds in schools, 
most agents, in our experience, tend to act on / 
intuition rather than because they have some ex- 
plicit game plan for dealing with a site. The 
relative importance of perspectives for the agents' 
effectiveness with clients suggests that agents * - 
would profit from a support system that requires 
them to clarify the assumptions and strategies 
that underlie their intuitively arrived at behav- 
ior patterns. Our suggestion is not that agents 
should gi l *e up their knowledge about how best to 
respond to clients in particular settings. Rath- 
er it may be important to urge the agents to stand £ 
back from their own behaviors and to determine 
* how those behaviors either do or do not add up 
t to *a strategy that will be effective with the 
group they are trying to Influence. (Louis and 
Kell, 1981, p. 171) 
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Finally, t(ie RDU descriptions indicate that agents 1 strategies and 
approaches to change were primarily the products of their own backgrounds 
and training. Because all were professional educators, they /brought to 
their roles a heavily individualistic, psychological orientation that often 
prevented them from seeing the school system as a social and political 
system of power and influence. In most cases, they learned through, 
trial-and-error processes. As we have noted earlier, formal training 
provided by the RDU projects appeared to have little impact on their 
role performance, but repeated contact with significant 'others (e.g., 
project and host agency supervisors and school administrators) tended to 
shape the orientation of their roles. In most cases, no one except the 
agents themselves was in a position to observe and reflect on the appropri- 
ateness and effectiveness of their efforts. High levels of boundary-spanning 
and interaction among key representatives of the various agencies they 
were linking increased role conflict, but this conflict was not necessarily 
< dysfunctional to job performance, although it undoubtedly created ambiguity 

with respect to obtaining "knowledge of results" that would .erve to 
reinforce effective learning. Because most agents spent much more time 
with school clients, these clients were often in a better ^position to 
influence agent behavior than were more distant supervisors and colleagues, 
who were much less well-informed concerning the si te speci fics and their 
implications for agent behavior and on-the-job learning. 

In all this discussion, we should note that we have focused almost 
exclusively on the linking agent-generalists. However, many schools in 
the RDU and DESSI (presumably NDN) programs also received focused training 
and substantial technical assistance from experts who assisted tha school 
si.tes in program implementation. Both types of technical assistance had 
significant impacts on school improvement outcomes. The RDU data 
especially make it clear that the general ist field agents were perceived 
by teachers and principals as more helpful to them than were the providers 
of{ specialized assistance (e.g., trainers, evaluators, program implementa- 
tion specialists). Over all, school staff preferred the su stained attention 
anld support of these general ists, as compared to the epi^odtr^T^rrti+ftg- 
event or brief consultant specialist visit. Both the RDU and the DESSI ^ 
data indicate that the more assistance schools received (especially 
on;-site) from both types of technical assistance providers, the greater 
wejre the benefits. However, although the general ists were apparently 
.more popular with clients, it appears that the amount and variety of : 
'/training received from the outside experts had a greater impact on school 
improvement. Moreover, the, DESSI and the RBS/LSI findings suggest, 
ttfat, where the basic, thrjijst of the innovation appears to constructively 
involve central office specialists, these i nternal -experts also contribute 
positively to significant school improvement outcomes. Unfortunately, the 
importance of multiple, complementary roles, although anticipated concep- 
tually both by Havel ock and by Butler and Paisley* has not been fully 
appreciated until recently. Consequently, the RDU and the DESSI studies 
provided us with some information on the roles and activities played by 
thbse "experts/' however, these studies tell us little abouf how programs, 
hojst organizations, or clients, in turn, affected the performance of 
these expert roles. / 
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For those interested in interorganizational ((ynamics and transactions 
of "Agencies, as* agents/ we commend the^ RDU report on designing and manag : 
ing interorganizational networks (Louis', Rosenblum, et al., 1981), as well' 
as several other school improvement interorganizational studie^{Yin and 
and Gwal^ey, 1981; Havel ock, Huberman, "Levi nson & Cox, 1982; Cates', 
1983). * - ' ; 

Having reviewed and summarized- the findings from these recent studies 
of .educational linking- agents, we tur*A; in the next chapter, to a discussion 
of their implications for school improvement in the 1980's. 
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CHAPTER V: IMPLICATIONS 



Prospects - for Educational Linking Agents and Agencies 
in an Era of Funding Cutbacks, Program Consolidation, 
■and Federal Retrenchment 



Although earlier legislation in the field of education contained 
implied requirements for dissemination, the impetus for federal involvement 
in dissemination and school improvement efforts can be traced to the National 
Defense Education Act of 1958, which contained the first majar federal , 
dissemination title (Vl'l-B), authorizing the U. S. Commi ssioner of Education 
to disseminate information concerning new educational media, including 
the results of research and experimentation yto state and local education 
agenfcies for use in their public elementary Qmd secondary schools and to 
institutions of higher education. Under Title VII-B, early experiments 
and pilot tests of educational information communication and dissemination 
methods were accomplished, including studies that prepared the first founda- 
tions of the Educational Resources Information Center (ERIC) system. The 
second major educational dissemination impetus came with the Elementary 
and Secondary Education Act (ESEA) of 1965. One of the key concepts of 
the ESLA and ofcrnany subsequent federal education programs was that external 
support for and stimulation of research and innovation could produce new 
ideas and methods needed to improve educational practice. Beyond providing 
schools with supplementary fiscal resources, these federal programs often 
dealt, either directly or indirectly, with the need to build national, 
regional, state,, and Ipcal capacity to produce, disseminate, arfd^use new 
knowledge and technology to improve American schools. Although some 
-federal programs irrcTuded support for totally local innovation efforts, 
most federally sponsored school improvement efforts made provision to 
disseminate new products and practices, whether they were created by research 
and development or by practitioners themselves, so that useful new ideas, 
products, and practices would be made available to educators everywhere. 

To assure better access to documentary sources of knowledge not 
appearing in commercial books and instructional materials; the Educational 
Resources Information Center (ERIC) Was established in the late 1960s. 
In the summer of 1970, the Pilot State Dissemination Program was*feegun 
(in Oregon, South Carolina, and Utah) as a two-year experiment to^test 
the feasibility of markedly increasing education practitioner access to, 



*By 1975, the Interstate Project on Di semi nation (IPOD, 1976) had identified 
a total of 208 dissemination requirements' in federal education legislation 
and regulations, as well as 54 agents or agencies that were assigned responsi 
bility at that time for the various educational dissemination activities. 



193 



and use of, ERIC resources through the employment of "education extension 
agents." The success of this effort, in turn., laid the foundation for the 
initiation in 1975 of the State Dissemination Grants Program (SDGP), which 
0 . in the ensuing years has enabled most state education agencies (SEAs) in the 
nation to increase their capability for delivering information to educational 
practitioners and others through information "linkers." The SDGP process 
of increasing SEA capacity, as we have noted in Section III-A, followed 
different patterns, depending on SEA history and context, but the objectives 
of the program were generally c achieved. 

During the same period, national and statewide mechanisms were created 
for identifying, validating, and disseminating promising practices that had^ 
been developed and evaluated by various federally funded programs. With 
federal leadership* and support, SEAs were aided in de/el oping Identification, 
Validation, and Dissemination ( I VD) programs to identify and disseminate 
throughout their states £he best educational programs produced for schools 
and other educational agencies in each state. At the national level, the 
Joint Dissemination Review Panel (JDRP) was formed to coordinate the review 
and approval of products and programs funded by the U. S. Office of Education 
and the National Institute of Education. 

1 Created by the U. S. Office of Education in 1974, the National Diffu- 
sion Network (NDN) began as a mechanism for disseminating.on a nationwide 
basis JDRP-approved products that had been funded under various ESEA ti- 
tles. Over the fol lowing >years, the NDN has matured to become a highly ef- 
ficient and effective dissemination network that now serves schools through- 
out the nation. Shortly after the creation of the NDN, the National Insti- 
tute of Education di rectly, confronted the problem of finding a more effec- 
tive and powerful way to combine the results of recent research on planned 
instructional change process support with its inventory of R&D-based pro- 
grams and products. The NIE developed a massvve, multiyear fierld experiment 
that became the Research and Development-Utilization (RDU) Program, whiph 
was initiated in June 1976. And during the same period, state and intermediate 
education agencies also began to undertake their own state and* federally 
funded dissemination programs (e.g., state ESEA Title IV-C, the, California 
^School Improvement Program and the New Jersey Program for Thorough and Effi- 
cient Education). Education service agencies, now numbering more than 1,000 ^ 
and located in a majority , ?J)ut not all, of the states, became another 
important link between state and federal agencies on one side and schools 
and school districts on the other. ESAs are as diverse in their functions, 
size, and governance structures as in their ifames: boards of cooperative 
services, educational ^improvement centers, educational service centers, 
county offices, intermediate units, etc. (Moran & Histchins, 1981). Some 
are formal regional service branches of the SEAs; others operate with qua^i- 
official state sanction; still others are independent cooperatives formed by 
local education agencies. As we have seen, many of the major federally 
funded, dissemination programs included in this synthesis have involved use 
of linking agents located in these intermediate services agencies. 

There is now in place a massive, but loosely Structured configuration 
of federal, state, intermediate, and local public and private agencies oper- 
ating under the aegis of many different federal, state, and* other projrams 
to provide various forms of dissemination and school improvement 'assistance 
to schools. » 
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At the federal level, for more than two decades; federal categorical' 
programs, now numbering in. the hundreds, were based on various strategies 
(e.g, "seed money," "capacity building/' "supplementation") t(iat implicitly 
assumed "growth" models of schools in which slack state, intermediate^ and 
local educational agencies' resources could be mobilized and articulated to 
undertake innovations that might be financially costly or organizationally 
risky. 

These developments in .the field of educational dissemination between 
the late 1950s and the late 1970s were played out in the context of much 
larger social, economic, and political events that influenced their develop- 
ment. Iannaccone (1981) has summarized these trends and ; their implications 
for the politics r of education in general by noting that the years after - 
World War-II were a time of sustained economic growth, wnich created a benign 
environment that, in turn, fostered an increased federal role in social and 
educational problems. Further stimulated by the cold war and the baby boom 
of the 1950s, the U.S. society, in general —and^parents, in ^articul ar--bepame 
supporters of education. President. Johnson 's Great Society produced an 
extensive overlay of federal education policies atop existing—and also 
growing local and state policies. Resistance to federal policy changes was * * 
overcome by a federal administration that was dependent on revenues -from an 
expanding economy and traditional New Deal fiscal policies. The financial 
"carrot" of grants-in-aid was offered to induce educational change. Categorical^ 
social programs multiplied almost exponentially. Thus, ,over e time, a basic 
transformation in intergovernmental relations occurred, with increasing cen- 
tralization of educational policy-making 1 in Washington as one of the/major con- 
sequences. Educational leaders, afal 1 .levels, began to look increasingly to ' 
Washington, D.C., for national leadership and for support of new or expanding 
school improvement programs of toll sorts. 

However, from the late 1960s on, the socioeconomic conditions were 
gradually reversed. Energy became expensive; the international trade bal- 
ance became consistently more unfavorable, American productivity fell 
below that of many other industrial nations. Stagflation characterized 
the economy. At the sdme time, births dec-lined, thus reducing the number 
of students in schools and the number of parents with a direct stake in 
education. Meanwhile, at the other end of theage distribution, the pro- 
portion of older citizens began to grow, thereby increasing demands on gov- 
ernment resources to support medical, social security, and other programs 
for the elderly.. 

Moreover, the*central governments social engineering solutions to 
problems of equity and social justice played themselves out. Public sup- 
port for social programs diminished. In addition, evaluations of federal 
programs, although sometimes ove'rly preriiature or too narrow jn their def- 
inition and measurement o£ success indicators (see Section IV. D.), often 
declared these federal programs to be failures— or at least ineffective 
or inefficient. Money to support social and educational programs decreased 
in order support the war -in Vietnam and to meet many other governmental 
neffds. So the 1970s saw the federal government and the states both turn 
increasingly to regulation. A pufiit ive-stick rather than a carrot-reward 
style came to be a more prevalent aspect of governmental intervention in 
education. 
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But centralization- grew and, with it, increasingly intrusive regulation. 
By the late 1970s, the burgeoning costs.of social programs cut deeply into 
federal and state budgets. Deficit: spending and increased taxes were the 
governmental response. At the same time, there" was a retrenchment in for- 
eign affairs. Soviet intervention in Afghanistan and' the inability of the « 
U. S. to r.escue hostages in Iran caused many to reappraise America's inter- 
national power. A build-up of American military power seemed essential and 
became a top item on the federal policy agenda. Meanwhile, at state and lo- . 
cal levels, a similar growth of government and expansion of state and local ^ 
services imposed increasing tax burdens, leading" to taxpayer revolts in the 
form of far-reach irTg" tax-limitation initiatives. Finally, enormous economic 
shifts .on the' national and international level, accompanied by decreasing 
productivity, massive deficit spending, and" tight money policies designed to 
slow inflation contributed to the creation of a worldwjde financial reces- 
sion, that has directly and indirectly,*ffected the national, state, and 
local economies throughout the United States for the last several years. 
As a consequence, the environment in which American education finds itself 
in the 1980s is vastly different than it was in the 1960s and 1970s. To- 
day the financial condition of education in most states and localities is 
•grim. Although real income for public elementary and secondary schools in 
the United States increased by 40 percent during the 1970s, it has declined 
each df the first three years in the 1980s: While contending with rising 
costs and increasing taxpayer resistance, state and local governments now 
confront -an additional problem: a recessionary economy that, in some regions 
and localities, has already reached depression proportions. The depressed 
economy 'not only means smal ler'federal , state, and local tax revenues, but al- 
so has increased welfare and other social .service costs. Public education, 
which has long found at least modest suport" at state and local levels, now 
finds itself contending with many other pressing social interests for a 
share of increasingly constrained state and local budgets. . t 

Adding to these problems are federal cutbacks for education and the 
development of a distinctly different federal education policy. The 1980s 
broughjt to Washington, D.C. sn administration and a Congress that were both - 
disposed to establish a basically different approach, not only to American 
education, but to many, other social programs, that calls for federal spending 
cuts, program consolidation, deregulation, and a significantly diminished 
federal role. Although this approach is part of the agenda of ■ the -current 
administration, in our view the 1980 national elections signaled a needed 
fundamental change that appears to have far deeper social, economic, ' 
and political roots than a mere change in party power. Proposition 13 in 
California*, along with a wave of similar tax-limitation legislation, in other 
states, a .dramatic decline in trust in government and other social' institutions 
--including schools, and an increasing general malaise over'a declining 
"stagnation- type" economy are but a few of the many -indicators of deep- 
seated pgblic dissatisfaction. These attitudes and acts have prompted a far * 
more critical' and conservative approach to government, at all levels, in an 
effort to'redefine policies to better match the massive changes in re'gional , 
national, and international socioeconomic circumstances and the social and 
political mood of the voters. We seqm to have entered an era where past 
approaches have become suspect, if not completely distrusted. ^ 

At the federal level, the major political issues seem to be concerned 
with: establishing a stronger role for the United States in foreign affairs; 



'creating a favorable environment for business and industry 'so they may devel- 
op and restructure themselves to provide the jobs and goods needed to promote 

private- and. p_ubl ic-.s.ector_ growth; decreasing the invo_lvement_(3f__the fetfe/al 

government in the details of domestic affairs; reducing the scope>and role 
of governmental bureaucracies; and establishing a sense of leadership and di- 
rection that can encourage state and local governments to assume greater roles 
and responsibilities for directing and supporting domestic 'programs* so that 
the federal government can turn its attention and allocate its resources to 
higher-priority national and international political, economic, and military 
issues. In light of these salient federal policy 'concerns, education is no 
longer seen or treated as a priority federal issue. Federal cutbacks, program 
consolidation, and federal deregulation in education and many other social 
program areas are already in progress, and .there is little prospeGt that these 

* new directions for 'fe'deral domestic policy will be soon reversed. Moreover, 
given the now massive demands on federal resources to support current social t 
security, defense, and economic development program costs, the federal 
government is essentially broke, whether Democrats or Republicans are 
elected. Hence the continuing squeeze on federal domestic and discretionary 
programs is likely to continue, regardless of near-term political trends or 
changes in party power. 

Although the national and regional economies may improve eventually, 
thereby diminishing the stress on many state and local budgets, fiscal de- 

* mands in other public sectors, such as health, welfare, and public safety, 
are expected to continue to grow. Consequently, ev§n with an improved econ- 
omy, public education can expect to face a continuing challenge at state and 
local levels to win and maintain support that gOes beyond the most austere and 
basic levels of funding. In this environment, "growth" models. 9f educational 
change and renewal will need to be replaced with "austerity" and "efficiency" 

7 models fhat are far more closely. attuned to state and local political, econ- 
omic, and cultural contexts and to the cross-pressures of many special-inter- 
est groups inside and outside the education sector. ( 

These major political, social, and economic trends have both*negati ve 
and positive. impl ications for educational dissemination in general and for 
linking agents an,d agencies in particular. The negative aspetts loom large 
arjd appear grim. However, in our view, the picture is not so totally bleak 
as it may fi rst appear. 

* * 
It is now obvious that there will be significantly less federal funding 
available to support programs employing information specialists, external 
facilitators, linking agents, or technical assistance and training special- 
ist's. Here are some specifics. Manyjnajor federal technical assistance pro- 
grams, e.g\ , Desegregation Assistance^ESAA); ESEA IV-O, Teacher Corps, 
Women 's, Educational Equity, became .victims of the Educational Consolidation 
and Improvement Act (ECIA) consolidation. One'of the largest networks* of 
educational linking agents, the National Diffusion Network (NDN), was almost 
included in the ECIA Chapter 2 consolidation. It now survives as a mandated 
part of the Secretary of Education's ECIA Discretionary Fund. If NDN continues 
it is likely that the NDN State Facilitators will be asked to do more, with 
^substantial!}? less money. In the short run, support for the more than one 
hundred funded NDN Developer/ Demonstrator (D/D)- projects will be reduced 
appreciably. In the long run, the pool of candidate D/Ds may slowly disappear, 
due to the fact that most of the federal funds supporting locally developed 
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innovations were consol idated into ECIA Chapter 2. The state and local 
Title IV-C projects were also consolidated into ECIA Chapter 2. Local 
schools may still use their ECIA Chapter "2 funds to pursue any of the 
purposes of the programs consolidated into Chapter 2, but'the sums of .money 
are no longer concentrated in schools and districts in amounts permitting 
the creation of significant innovation projects. The state-run Title IV-C 
innovation networks have also been affected severely by the loss of categori- • 
cally concentrated LV=C funds. In most states, ECIA Chapter 2 state set-aside 
funds may be insufficient to maintain these state networks. Finally, as we 
have noted, the NIE Research and Development Utilization Program and the 
RBS LocaJ. School Improvement Program were both experiments that are no 
longer in operation. Thus, among the variolas programs that we have classified 
as, pursuing Problem-Solving Process/Program Implementation strategies, the ^ 
only surviving agents are those in the W and in some state Title IV-C 
networks that may continue to receive portions of the ECIA Chapter 2 state 
set-aside funds? Continued support for both groups of agents is highly 
uncertain. 

The problems for linking agents supporting information-use assistance . 
or technical assistance strategies is somewhat different, since they are less 
directly affected by ECIA Chapter 2. Although the NIE is now phasing out the 
several cohorts of states still receiving five-year State Dissemination 
Grants, some aspects of these SDGP projects Tiave been institutionalized; but 
state, intermediate, and local support for the thousands of linkers associated 
with this program may be significantly diminished due to critical shortfalls 
*>in state, intermediate/ and local education agency budgets. Moreover, federal- 
s -and state- supported networks of human agents serving i n compensatory, bilin- 
gual, special, vocational, and other education areas are also threatened by 
federal cut's and by state and local shortfalls (McDonnell and McLaughlin, 
1982, Hood, Cates, Hertng & McKibbjn, 1982). Depending on their capacity 
and service orientations,, some state and inte.rmedi ate education agencies 
have made remarkable efforts to maintain technical assistance services in 
the face of federal cutbacks and state and local shortfal Is. But many have 
already been forced to make deep reductions in programs and staffs, while 
many others are anticipating painful cuts. It appears that state and 
intermediate agencies are attempting to maintain provision of at least the 
most-wanted and. needed technical assistance services to local schools, but * 
often wjth significantly reduced staff and resources. 

Related problems exist at the local level. All the studies in our re- 
view that provided outcome data clearly point to the important, and usually 
. positive, contribution to school improvement outcomes made by teachers, prin- 
cipals, and central' office staff. However, many school districts are now re- 
ducing their administrative and support staffs. Many central-office positions 
have been eliminated, along with^ vice-pri nci pal positions, guidance counselors, 
school librarians, and others. Elimination of these positions has placet! 
many additional duties on remaining central-office administrators, school 
principals, and teachers. These circumstances mean that there are fewer 
persons, fewer dollars, and less time to devote to school improvement activ- 
ities. 'However, an even more profound set of organizational and environmental 
effects is now troubling many educators. The protracted years of enrollment 
dec-14-ne-and-the-4os-s-of-pub-14c-re-spect--f-or-teach-i ag_a-s-a-pcof ess-iOii^couplefL _ 
with increasingly severe budget problems and reductions in staff, have 
reduced opportunities for promotion and advancement. Along with work overload, 
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these factors have taken tfjeir toll in significantly lowered morale and 
espirit, job burnout, and lost self-esteem. As educational agencies have 
-been- forced to shift the.ir priori ties in order to"maintafn~coTe services^ 
organizational incentives have shifted to discourage any form of innovative ^ 
activity tha*t is not fcmne- or money-saving. And when ^hese teachers and. 
administrators turn to^e larger knowledge base (whether it be ERIC, NDN, 
a library, a college of education course', or a* state education agency 
consultant). they find -relatively few practice-relevant solutions^ that, at 
the same time, cieal effectively wfth school improvement "basics,*" cut costs 
substantially, or result in significant savings of labor or time, and yet 
•represent practical, low risk alternatives to current practices. 

.These are the realities that both external and internal linking agents 
will face in most schools in. the 1980s. In the Current climate, for many i 
educators the words "school improvement" may mean simply either providing a 
significantly better education for K-12 student^ at no real increase in cost 
or providing some "satisf icing" level of education at much reduced real 
cost. Neither our knowledge inventory, nor the skill? and experience of our 
linking agents are especially well qualified to confront either of these 
conceptions of school improvement. Too much of our attention has been directed 
to "add-ons," "pull-outs " and special categorical projects that have* given 
the prevaili ng .environment and change philosophies of the past 30 years, too 
often assumed an abundance of external (federal and state) resources and a 
reasonable amount of local slack resources (money, motivation, time, 
organizational incentives). , 

Three trends appear to have negative implications for linking -agents 
for the next several years. First, there are likely to be markedly ffewer 
categorical or programmatic dissemination and school improvement projects, 
primarily due to cuts in federal funds and to shortfalls in state and local 
funds. Secohd, there may continue to be a slow, but cumulative, erosion 
of institutional and organizational capacity to produce, disseminate, ,and 
use new knowledge to improve schools, except in limited, high-priority 
areas. As we have noted, this capacity will b,e reduced due to significant 
federal, state, intermediate, and local deductions in resources, including 
money, staff, time, energy, and organizational and professional incentives. 
Third, there will continue to be a marked shift in educational agency 
priorities toward an emphasis on provision of core services and maintenance 
of the traditional, long-established, and instutionalized agency functions. 
"Given these trends, external assistance to schools, whether based on informa- 
tion^use assistance, technical assistance, or more comprehensive problem- 
solving/program implementation strategies, is most likely to* obtain support 
and be successful only if it addresses v some combination of three essential 
ingredients: it faces and competently h^lps solve critical educational 
.problems, it is low-cost or cost-saving, and it is low-ri>sk (-political ly, 
organizationally, and professionally). 

These trends and likely conditions also have a positive implication. 
The q^eds for school improvement in the sense we have just described are perva- 
sive. Assistance that addresses these needs successfully will be supported, 
not as experiments, or demonstrations, or special categorical projects, but 
as highly valued, if not essential, support services needed to reform, renew, 
^artd-merrntain educational operations;; Restructuring the externa t-trnd interna Y 
technical assistance capability of educational agencies to perform these 
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functions wiU not be easy or painless. It is highly likely that* in many, if 
not most, cases*, * information assi stance,, technical assistance, and more 
comprehensive! change-support privities will become p&rt-time roles, performed 
by educational administrators, program specialists, teachers and professors, 
and others, rather thfln ful 1 -time .jobs performed by specialists.' However, 
it is our contention that these coles will be necessary and that an increasing 
rramber c£ educational administrators, support specialists, and other educational 
professionals will perform 'them as responsible educators who must cope with" 
the* chal lenges and demands of educating citizens for life in a highly dynamic, . 
post-industrial, information-processing society. In such a society, school 
improvement may eventuaj ly no longer* be viewed -as a collection of individual, 
interesting "ideas 1 " and "innovations" to be episodically and singly adopted, 
implemented, and then incorporated or discarded, but rather as an intrinsic * - 
and contiguous aspect of the adjustment and renewal functions of a dynamic, 
adaptive process oriented schooling institution. 

Is this outcome even possible, let alone likely? We, believe it is. 
The primitive patterns for its success are to be found in the studies we 
have reviewed., The Linking R&D with Schools (RDU) study found that high- 
quality, R&D-based or* validated practitioner-developed products^helped to 
create significant school-level effects*on instructional and organizational 
change, with multiple benefits. However, the fit' between the product and* 
the local site was even more important, Produtts and practices developed 
putside schools can be implemented in .classrooms with little or no substantial 
adaptation if schools carefully define their local needs, if school stjpff * 
follow^a systematic process to identify a product or practice that not only 
meets those needs, but fits the local context, and, ofccourse, if a product 
meeting those requirements is /available. External asistance by competent 
professionals was an important contributor that affected the degree and 
scope of use and the quality of ^many other outcomes. External agents providing 
assistance fell into two distinct categories: general ists , who provided 
sustained assi stance 'for staff mobil ization, need definition, problem-solving,' 
and continuing support activities; and' specialists , who provided substantive 
.technical assistance and training preparing for, and implementing, new 
practices. Money was also important. Although there was no relationship 
between the total cost of the school improvement activities at, a site and 
the site's success, some "riok" money was important. Money was a motivator. 
It helped to get things going. It was particularly important to provide for 
released time, so that staff could be involved in the process of selecting 
a solution and in planning for implementation. Moreover, although total 
amount of money showed no relation to degree of success, too much dependence > 
on outside funds tended to have negative impacts; but there was ,a significant 
positive relationship between success and the percentage of total costs 
borne by local resources. Strong local financial, organizational, and personal 
commitment all helped to foster successful in^plementation, with positive 
benefits. 

'* 

The Dissemination Efforts Supporting School Improvement (DESSI) study 
is particularly remarkable for its finding that the scope of change being 
attempted'is related both to the success that can be expected and to the kind 
of assistance that is appropriate. One of the major DESSI conclusions is 
that, if the new practice is not very different fr*om the current practice, 

_the_Galy~ t hiag~a~diss.emtnatar xaiLda J^^CLgim. teajchersL i n if o rma_t ion abou t m 

the new practice and then leave them alone. Beyond this, there was* 00 
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discernible way to enhance the outcomes, and the presence of an outsider may • j> 

rapidlv become negative. However, in schools where use of the new practice 
represents a major change from existing P^ctice, two fairly independent 
processes seem to be at work. One, operating at the level of the individual- 
teacher, results jn change in classroom practice. The other, operating at 
the school level, results in- organizational change and Institutionalization 
of new practice. And, as in the RDU study, the DESSI study also clearly 
-demonstrated that successful school, improvement efforts involved a constel-._ 
lation of key actors: "teachers, principals, central office staff, and ex- 
ternal agents, each playing a critical, complementary role. The DESSI study 
also found that the effective transfer of new practice is far more an inter- 
personal than a strictly informational- enterprise. Because this study in- 
vestigated contrasting dissemination strategies, ranging from much face-to- 
face, at-the-school-site. interaction, to no interpersonal I interaction at a , 
it strongly corroborated earlier findings about the significant and powerful 
effect of interpersonal influence. 

Although small-scale change can be initiated by individual facilitators, 
major changes-typically were most successful where several • 1 ^J™ 1 .J"* , 
-external sources of interpersonal assistance were organized. This J"ngs-us 
to a final point; namely, to' note that, especially in the NDH and RDU projects, 
networks of external assistance resources were established and marshalled 
selectively to supply the particular peeds of different sites over Various 
• phases of change. In both.cases, time, measured in years rather than months, , 
was required to establish efficient networks of support operations and to 
achieve potent, major change in school site operations. ^When the costs of 
these school improvement support efforts are compared to the costs of daily 
operations of schools,. they are not particularly large 'and appear to pay off 
in terms of. many benefits. 

However^ neither the technical assistance support networks themselves 
nor the change projects they engender in schools are 1 ikely developed _ . 

and supported solely by individual operating schools . Hence we confront 
two related dilemmas- -where will the leadership *nd resources to establish 
and maintain school "improvement support networks come from, if the federal 
government relinquishes this support role? And how can such support • 
~ operations be made more efficient, effective, and relevant to current„needs? 



• Thus, in looking back over 'these implications, we conclude that support 
for linking agents and agencies is Substantially less certain than.it was 
in the 1970s. However, we also conclude that the effectiveness of external 
assistance provided by linking agents, particularly those providi ng prob em- 
solving/ program- implementation assistance, has been proven. Educational 
agencies, at state, intermediate, and local level swill, need to decide whether 
and how they might work together to build. and maintain external assistance 
networks. If these networks can face and respond effectively to the critical 
needs of schools in the 1980s, there will continue to be an .Important role 
for linking agents to serye in school improvement efforts.. 
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